all AI news
Reddit Migrates Media Metadata From S3 and Other Systems into AWS Aurora Postgres
March 31, 2024, 4 a.m. | Rafal Gancarz
InfoQ - AI, ML & Data Engineering www.infoq.com
Reddit consolidated its media metadata storage into a new architecture using AWS Aurora Postgres. Previously, the company sourced media metadata from various systems, including directly from AWS S3. The new solution simplifies media metadata retrieval and handles 100k+ requests per second with latency below 5ms (p90).
By Rafal Gancarzai architecture architecture & design aurora aws aws s3 cassandra latency media metadata ml & data engineering per postgres reddit retrieval s3 solution storage systems the company
More from www.infoq.com / InfoQ - AI, ML & Data Engineering
Devnexus 2024 Celebrates 20 Years of Java Developer Conferences
2 days, 18 hours ago |
www.infoq.com
Jobs in AI, ML, Big Data
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Developer AI Senior Staff Engineer, Machine Learning
@ Google | Sunnyvale, CA, USA; New York City, USA
Engineer* Cloud & Data Operations (f/m/d)
@ SICK Sensor Intelligence | Waldkirch (bei Freiburg), DE, 79183