Projects

A selection of personal and open-source projects.

CargoIMP Spark Parser

Parser for Cargo-IMP messages into structured Spark/Delta format

projectparsersparkscalaaviationlogisticsdata-engineering

CarrierPerformanceReportsEtl

Modular Spark/Scala streaming & batch platform for carrier performance analytics with automated schema evolution and governed delivery.

projectsparkscalakafkaetldata-engineeringdeltastreamingschema-evolutiondata-qualitycdckerberossecuritysql-serverdotnetvuefull-stackorchestrationschedulerwtgsupply-chain

Fantastic Spork

fantastic-spork is a Scala library for Apache Spark

projectsparkscalasqlperformancetext-processing

PixieToon

Android app that cartoonizes photos using a TensorFlow Lite model.

AndroidMachine LearningTensorFlow LiteComputer VisionWhite-Box Cartoonization

RedactifyAI

AI-assisted redaction tooling

projectaipiiprivacypythonsparknlpdata-governance

SafetyCultureToDatabricks

Ingest SafetyCulture data into Databricks

projectetldotnetcsharpapidatabricksdelta-lakeautomation

Sparqlin

Spark SQL framework for Databricks jobs.

projectsparkdatabricksframeworksqlpysparkproductivity

TableauUsageToDatabricks

Pipeline to export Tableau usage stats into Databricks

projectetldotnetcsharpapitableaudatabricksanalyticsmetadata