Catherine ShenImprove Airflow ObservabilityFrom reactive engineering to proactive engineeringNov 3, 2023Nov 3, 2023
Catherine ShenUplevel your data transformation with DBT8 reasons why you should use dbt for data transformationNov 23, 2022Nov 23, 2022
Catherine ShenAirflow Cross-DAG DependenciesEverything you need to know about connecting Airflow DAGs.Jul 20, 2021Jul 20, 2021
Catherine ShenScale Kafka ConsumersHorizontally scaling and vertically scaling.Jan 15, 20213Jan 15, 20213
Catherine ShenWhy you should use Avro and schema registry for your streaming applicationBoost your streaming pipeline using Avro and Schema Registry.May 17, 2020May 17, 2020
Catherine ShenProcess Streaming Data with Spark Structure StreamingGet started with Apache Spark Structure Streaming for your realtime applications.Apr 14, 2020Apr 14, 2020
Catherine ShenFine-tuning your LambdasDiagnose and decrease AWS Lambda latency for stream-based invocations.Dec 7, 2019Dec 7, 2019