Anonymous View

DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Architecture Over Alerts: How We Cut BigQuery Costs by 57%($12M) for a Fortune 500
pratikdhanave profile

Architecture Over Alerts: How We Cut BigQuery Costs by 57%($12M) for a Fortune 500

#bigquery #finops #cloudarchitecture #dataengineering
Comments
4 min read
I Built a Columnar File Format in Pure Python — a tiny, readable Parquet
hajirufai profile

I Built a Columnar File Format in Pure Python — a tiny, readable Parquet

#python #dataengineering #database #programming
Comments
6 min read
Running Apache Airflow + Docker for Free Using GitHub Codespaces
tanmay_bhurkunde profile
Tanmay

Running Apache Airflow + Docker for Free Using GitHub Codespaces

#dataengineering #docker #python #apacheairflow
Comments
1 min read
Why Big Tech is Migrating from Traditional Databases to NewSQL
dinhphu2k1gif profile

Why Big Tech is Migrating from Traditional Databases to NewSQL

#bigdata #dataengineering #database #sql
1
Comments
1 min read
Organizing How to Use AWS Lake Formation
datapenguin profile

Organizing How to Use AWS Lake Formation

#aws #dataengineering
3
Comments
9 min read
ETL Pipeline: Fetching Real-Time News Data with Python and Postgres
gathurum profile

ETL Pipeline: Fetching Real-Time News Data with Python and Postgres

#dataengineering #api #etl #beginners
1
Comments
4 min read
How Excel is Used in Real-World Data Analysis
patrickomondi profile

How Excel is Used in Real-World Data Analysis

#dataanalysis #datascience #ai #dataengineering
Comments
2 min read
I built a mini columnar storage engine in pure Python — and finally understood why Parquet is so fast
hajirufai profile

I built a mini columnar storage engine in pure Python — and finally understood why Parquet is so fast

#dataengineering #python #database #performance
Comments
6 min read
One command from your laptop to Kubernetes — no CI pipeline
neochaotic profile

One command from your laptop to Kubernetes — no CI pipeline

#airflow #go #kubernetes #dataengineering
Comments
7 min read
LINUX FUNDAMENTALS FOR DATA ENGINEERING.
angellicah_2ed8aa8f01f176 profile

LINUX FUNDAMENTALS FOR DATA ENGINEERING.

#linux #dataengineering #devops #tutorial
Comments
5 min read
Why I Don’t Let the LLM Decide Issue State
ahmadhumayun profile

Why I Don’t Let the LLM Decide Issue State

#ai #python #dataengineering #marketinganalytics
Comments
5 min read
Your Scraper Collected 50 Rows. There Were 4,000.
0012303 profile

Your Scraper Collected 50 Rows. There Were 4,000.

#webscraping #python #dataengineering #pagination
Comments
7 min read
Deeper into Dataform 3: Auditing Dataform
ben_watson_data profile

Deeper into Dataform 3: Auditing Dataform

#dataform #dataengineering #gcp #bigquery
Comments
2 min read
How I Broke Down My ETL Pipeline Project Into Smaller Engineering Exercises
tanmay_bhurkunde profile
Tanmay

How I Broke Down My ETL Pipeline Project Into Smaller Engineering Exercises

#dataengineering #database #etl #sql
Comments
2 min read
I built a data-contract validator in pure Python (no pandas, no PyYAML) and it caught a 30% revenue ghost
hajirufai profile

I built a data-contract validator in pure Python (no pandas, no PyYAML) and it caught a 30% revenue ghost

#python #dataengineering #datascience #opensource
Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.