Data, Databases & Streaming

Relational & NoSQL databases, search, caches, streams, ETL/ELT, and analytics stacks.

  • 7 Subtopics
  • 15 Tracked terms
  • Last 30 days Feed window
Search within this topic Ask AI about this topic All topics

Inside Data, Databases & Streaming

Relational (SQL) Postgres/MySQL/SQLite tuning, HA/DR, indexing, and query planning. NoSQL & NewSQL Document, key-value, columnar, search, and distributed SQL engines. Search & Relevance Engineering Full-text search, ranking, synonyms, vectors, and hybrid retrieval patterns. Caching & Edge Data KV stores, CDNs, edge runtimes, and latency-first data patterns. Streaming & Queues Event streaming, pub/sub, backpressure, and consumer groups at scale. ORMs & Migrations Type-safe models, schema diffs, seed data, and multi-tenant strategies. Data Engineering & Analytics Pipelines, orchestration, dbt, warehouses, BI, and governance/lineage.

What this topic collects on

An article joins this feed when it matches these terms. Each one is also a search of its own.

Latest in Data, Databases & Streaming


dev.to > baba_yaga_dee9f44c728109e > redis-vs-memcached-complete-comparison-2kg6

Redis vs Memcached: Complete Comparison

34+ min ago   (942+ words) In the high-stakes world of modern application development, performance and scalability are paramount. Developers and architects constantly seek robust solutions to reduce database load, accelerate data retrieval, and enhance user experience. Two names frequently emerge at the forefront of in-memory…...


dev.to > aniketsoni > stop-trying-to-make-airflow-work-for-medallion-pipelines-15ge

Stop trying to make Airflow work for Medallion pipelines

37+ min ago   (318+ words) The "universal orchestrator" is a myth that keeps data engineers awake at 3:00 AM chasing zombie DAGs... Tagged with data, airflow, databricks, aws....


dev.to > miruky > build-a-dynamodb-outbox-and-an-idempotent-sqs-consumer-in-the-console-1e2b

Build a DynamoDB Outbox and an Idempotent SQS Consumer in the Console

1+ hour, 59+ min ago   (1251+ words) Introduction Hi, I'm miruky. A database commit can succeed while the caller believes... Tagged with aws, serverless, dynamodb, tutorial....


dev.to > kestre88 > backups-and-other-lies-266c

Backups and other lies

3+ hour, 53+ min ago   (177+ words) Every sysadmin I know has the same secret: we do not actually back up half the things we tell other people to back up. I have been doing this for a decade. My recovery codes live in a directory called…...


dev.to > akshay5651 > designing-offline-first-when-theres-no-server-1m4k

Designing offline-first when there's no server

4+ hour, 38+ min ago   (560+ words) I'm building an app with no backend. No accounts, no sync, no API. The database is a SQLite file on the phone, and that's the whole system. That sounds simpler than a client/server app. In some ways it is....


dev.to > akshay5651 > stop-storing-money-as-a-float-4mbc

Stop storing money as a float

5+ hour, 1+ min ago   (185+ words) I'm building an expense-splitting app for couples. Early on, I stored every amount as a double. It worked until two people split a ₹1,000.05 grocery bill three ways — and the app insisted someone still owed ₹0.01 that nobody could pay. The fix:…...


dev.to > bejaouibechir > clean-a-million-rows-with-hydra-etl-no-database-no-docker-nm1

Clean a million rows with Hydra ETL — no database, no Docker

5+ hour, 48+ min ago   (296+ words) A copy-paste tutorial: generate a 1M-row CSV, describe the pipeline in four small YAML files, validate it before running, then compare the Python and Rust engines. Tagged with dataengineering, python, rust, tutorial....


medium.com > @kabirbakovic > postgresql-will-let-you-invent-a-type-right-up-until-it-asks-for-a-c-compiler-67593aede3d6

PostgreSQL Will Let You Invent a Type, Right Up Until It Asks for a C Compiler

1+ hour, 33+ min ago   (41+ words) A partner feed lands a million order rows a day, and the order date arrives as 03/15/2021. Someone stores it in a text …...


dev.to > martinhicks > dynamodb-vector-search-without-embeddings-5m2

DynamoDB vector search without embeddings

6+ hour, 49+ min ago   (553+ words) So I had a go at the geography case. The setup is a store locator, which is about the most ordinary geography question going. Seven real places stand in for shops, five in and around Leeds and two over in…...


medium.com > @mohitrai0789 > i-fine-tuned-a-0-6b-model-for-data-migration-7dcb6fbb9325

I Fine-Tuned a 0.6B Model for Data Migration.

2+ hour, 18+ min ago   (595+ words) I started Migrato because I wanted to properly learn LoRA, fine-tuning, and small language models. But I didn’t want to fine-tune a model on some …...