DEV Community

# bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Your warehouse isn't expensive. Your full table scans are.
fagundesv profile

Your warehouse isn't expensive. Your full table scans are.

#bigdata #bigquery #redshift #aws
5 min read
Top 12 Spark Interview Problems for Data Engineers, With Answers
datadriven profile

Top 12 Spark Interview Problems for Data Engineers, With Answers

#spark #bigdata #dataengineering #interview
10 min read
Does Early Dragon Control Help Scaling Compositions? A Big Data Analysis of League of Legends
remi_foures_036456c35af85 profile

Does Early Dragon Control Help Scaling Compositions? A Big Data Analysis of League of Legends

#bigdata #leagueoflegende #python #karmincorp
9
4
4 min read
The Future of Query Optimization: AI-Driven Insights in Big Data
fuadhusnan_f44f3e13 profile

The Future of Query Optimization: AI-Driven Insights in Big Data

#bigdata #database #ai
7 min read
Predictive Maintenance in 2026: How AI, Edge Computing, and Agentic Systems Turn Detection Into Action
sciforce profile

Predictive Maintenance in 2026: How AI, Edge Computing, and Agentic Systems Turn Detection Into Action

#ai #manufacturing #bigdata #datascience
14 min read
How Uber Built Its Big Data System — From a Few TBs to 350 Petabytes with Sub-Hour Latency
dinhphu2k1gif profile

How Uber Built Its Big Data System — From a Few TBs to 350 Petabytes with Sub-Hour Latency

#bigdata #dataengineering #apachehudi #architecture
9 min read
Migrating a ScyllaDB Cluster the “Brain Transplant” Way
sadoyan profile
Ara

Migrating a ScyllaDB Cluster the “Brain Transplant” Way

#scylladb #bigdata #database
6 min read
"We Have DevOps, So Why Not DataOps?"
sezin_oztekin profile

"We Have DevOps, So Why Not DataOps?"

#datascience #bigdata #dataops #devops
2 min read
Valentina Studio v17.3 supports new VARIANT field type of DuckDB v1.5
zasukhin profile
Ruslan

Valentina Studio v17.3 supports new VARIANT field type of DuckDB v1.5

#duckdb #valentinastudio #bigdata #database
1 min read
Why Big Tech is Migrating from Traditional Databases to NewSQL
dinhphu2k1gif profile

Why Big Tech is Migrating from Traditional Databases to NewSQL

#bigdata #dataengineering #database #sql
1
1 min read
The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases
manishpodiyal profile

The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases

#bigdata #spark #pyspark #dataengineering
2 min read
The Next Decade of Data Engineering: From Modern Data Stack to Data Engineering Harness
seatunnel profile

The Next Decade of Data Engineering: From Modern Data Stack to Data Engineering Harness

#data #dataengineering #dataengineeringharness #bigdata
1
8 min read
Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun
wilians_conde_6d4bbc5eed2 profile

Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

#dataengineering #mongodb #systemdesign #bigdata
3 min read
Fentanyl Poverty: Building a Big Data Pipeline to Map America's Overdose Epidemic
stiiwann_35eb8bb2cf8dc53e profile

Fentanyl Poverty: Building a Big Data Pipeline to Map America's Overdose Epidemic

#bigdata #elasticsearch #spark #python
5
4
3 min read
ETL vs ELT: Which One Should You Use and Why?
petermuriya profile

ETL vs ELT: Which One Should You Use and Why?

#dataengineering #etl #elt #bigdata
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.