close

DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why I Built DagSmith: Bringing a Visual Drag-and-Drop Editor straight into Apache Airflow 3
adrian_galik_byteway profile

Why I Built DagSmith: Bringing a Visual Drag-and-Drop Editor straight into Apache Airflow 3

#python #airflow #dataengineering #opensource
Comments
3 min read
Data Engineer Salary 2026: Every Survey Is Lying to You
datadriven profile

Data Engineer Salary 2026: Every Survey Is Lying to You

#dataengineering #career #interview #beginners
Comments
7 min read
Zero-Downtime MariaDB PostgreSQL Migration: Why the Usual Tools Fell Short, and How Debezium CDC Solved It
wwr0ngn4m3 profile

Zero-Downtime MariaDB PostgreSQL Migration: Why the Usual Tools Fell Short, and How Debezium CDC Solved It

#database #dataengineering #devops #postgres
Comments
9 min read
Your AI Bill Is a Routing Problem, Not a Model Problem
fagundesv profile

Your AI Bill Is a Routing Problem, Not a Model Problem

#ai #data #dataengineering #python
Comments
3 min read
Distributed Metadata Migration
ai_cloud_data_handling profile

Distributed Metadata Migration

#database #dataengineering #distributedsystems #systemdesign
Comments
3 min read
PCI DSS 4.0 Just Made Your Staging Database a Liability. Here Is the Fix
jitendra_devabhaktuni_0f1 profile

PCI DSS 4.0 Just Made Your Staging Database a Liability. Here Is the Fix

#ai #database #datascience #dataengineering
Comments
5 min read
Creating a QuantifiedSelf Dashboard - Part 1
undersilentskies profile

Creating a QuantifiedSelf Dashboard - Part 1

#quantifiedself #dataengineering #duckdb #evidencedev
Comments
8 min read
The Model Didn't Change. A Parameter Disappeared. Thousands of Pipelines Broke.
fagundesv profile

The Model Didn't Change. A Parameter Disappeared. Thousands of Pipelines Broke.

#ai #data #dataengineering #python
BERJAYA 1
Comments
2 min read
Common Mistakes New Data Engineers Make (And How to Avoid Them)
akonagalla28 profile

Common Mistakes New Data Engineers Make (And How to Avoid Them)

#dataengineering #career #sql #python
Comments
3 min read
Building a right-click 'query this file' workflow in VS Code with DuckDB
arunkumarbhat88 profile

Building a right-click 'query this file' workflow in VS Code with DuckDB

#vscode #duckdb #sql #dataengineering
Comments
2 min read
The Day I Realized "It Ran Successfully" Means Nothing in Databricks Production
dcmerritt profile

The Day I Realized "It Ran Successfully" Means Nothing in Databricks Production

#databricks #dataengineering #spark #career
Comments
6 min read
Cloud Bills Took a Decade to Get FinOps. AI Bills Won't Get That Long.
fagundesv profile

Cloud Bills Took a Decade to Get FinOps. AI Bills Won't Get That Long.

#ai #data #dataengineering #python
BERJAYA 1
Comments
4 min read
Python batch를 Spark로 옮겼더니 802.675가 달라졌다
junhyun-dev profile

Python batch를 Spark로 옮겼더니 802.675가 달라졌다

#dataengineering #spark #apacheiceberg #airflow
Comments
3 min read
A CSV quality report should not echo the data it rejects
square12_82a85fc8609fdd1f profile

A CSV quality report should not echo the data it rejects

#python #dataengineering #privacy #tooling
Comments 1
2 min read
Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust
alexmercedcoder profile

Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust

#agents #ai #dataengineering #llm
Comments
19 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.