Portfolio

Much of our work recently has been for government agencies and is confidential.

Serverless Project

One project for a government client involves uploading a multi-tab Excel file to a S3 bucket. The S3 upload triggers a Lambda function to run, pick up the file and that validate the Excel file based on data dictionary and additional rules regarding ETL. This is a pre-process to validate the data before uploading to Maximo system which can take hours. This process takes 2-3 minutes generally.

When the validation is complete an errors file is created show line numbers and issues for the Excel file authors. This errors file is emailed to the team as an attachment and the status of the file pass/fail is prominent in the email and subject. SNS is also used if the function fails on exception for some reason (very rare), wrong file type uploaded or wrong tabs in file.

This is just a small example of using small microservices and serverless technologies to augment a long-standing process. This process of pre-processing the files saves the staff and end-users hours of time. The file can fail quickly, within 2-3 minutes, and be given back to the end-user with errors delineated. Otherwise the file would be submitted to the longer Maximo process initially, take hours to process, and fail.