spark qns

1m read · 40 words

Ensure data quality in sales pipeline
Secure customer PII in data warehouses
Manage pipeline orchestraction at walmart scale
Optimize spark jobs for terabytes of Point of sale data

How to ingest and process over 1 million events per day efficiently

Colophon 40 words · 1m read
Written as a markdown note in Obsidian. Built into this page by a Python script on 2026-10-02.

Pages