Asimansu Bera(He/Him)

YugabyteDB’s automatic sharding overcomes PostgreSQL’s partition key limitations by allowing date range queries without modifying table partitioning.💡 Check out the new blog from Yugabyte expert Franck Pachot for more information, and step-by-step instructions!⬇️ https://hubs.la/Q02s_wKx0 #Yugabytedb #postgresql #sharding #partitionkey #cloudnative #partitioning

14

Boost query speed, reduce latency, and enhance cost efficiency without sacrificing accuracy by moving in-memory I/O traffic to SSDs. See how DiskANN is now built into #AzureCosmosDB. #DiskANN https://lnkd.in/evc49kWB

8

It gives us great pleasure to announce that Apache Spark in BigQuery is now officially available in Private Preview. This feature expands BigQuery’s processing capabilities by offering Apache Spark as an OSS processing engine under a unified control plane (admin, monitoring, billing, security, governance). It is the first step in delivering on the Unified Data Platform vision and was a key announcement at Next ‘24 #googlecloud #bigquery #spark

38

2 Comments

Watch this quick tutorial to learn how to leverage scrapable metrics for Managed MySQL, PostgreSQL, Redis, and Kafka clusters on DigitalOcean. #Database #ApacheKafka

18

💡 Want to optimize your applications with #AzureCosmosDB NoSQL and #OpenAI? Learn how the RAG pattern can eliminate the need for separate vector databases. Join Sandeep Nair in this insightful session: https://lnkd.in/ezx6s8yu

3

Scalable RAG with Azure Cosmos DB and DiskANN | Studio15 We’ll talk a bit about Cosmos DB and DiskANN, before delving into a quick coding example of vector search using #AzureCosmosDB’s #Python SDK in a Jupyter Notebook. https://lnkd.in/ehT5b7pS

1

Learn via Doron S. how you can scale Postgres via partitioning (inheritance and declarative) and sharding (application and extensions).

20

1 Comment

Redis is a powerful tool, but what happens when you need to scale it without clustering? Check out our recent blog post on "Scaling Redis without Clustering". We share insights on how to manage performance and speed without compromising on Redis's capabilities. Find it here: https://hubs.la/Q02x3ZNG0

7

🚀 Announcing dynamic scaling per region and per partition (public preview) for new #AzureCosmosDB accounts! Optimize costs as regions and partitions scale independently based on usage. Perfect for non-uniform workloads. 🌍💡 https://lnkd.in/dNaiHHYq

1

Really excited about the 'Hudi-rs' release 🎉 Not every data workload requires the need for distributed processing and to setup Spark & JVM to execute them. In fact, there has been an increasing trend in terms of using Rust & Python-based compute engines for a range of workloads. The hudi-rs project is a native Rust library for Apache Hudi, with bindings into Python. This opens up an exciting new world where users can read Hudi tables using non-JVM compute engines. Under the hood, hudi-rs uses #ApacheArrow. So, it scans the Hudi table and reads out records as Arrow RecordBatch. RecordBatch is a table-like data structure that is semantically a sequence of fields, each a contiguous Arrow Array. Once the records are in an Arrow Table, you can easily use it with Arrow-native and integrated tools such as DuckDB, Polars, Daft etc. for further analysis. This is an exciting new direction for open lakehouse platforms like Hudi that brings differentiating capabilities such as: incremental processing, multi-modal indexing subsystem, open table services, among others. We would also love to have any sort of community contributions & PRs. Check out the contributing link & repo in comments. #dataengineering #softwareengineering

128

3 Comments

Deploy a FREE fully distributed PostgreSQL database using new #pgEdge Cloud Developer Edition. Features multi-master replications, asynchronous logical replication, low latency, high availability, edge integration, and rapid deployment. It's always on. Always fast. Sign-up & deploy for free! https://hubs.la/Q02wFH9z0 #postgresql #postgresprofessionals #clouddeveloper #multimaster #Highavailability

5

Did you hear about the launch of Redis Data Integration (RDI)? RDI is our out-of-the-box data streaming pipeline that mirrors data from your database into Redis instantly—without writing code. Want to learn more? 🤔 Join us on July 31st. We’ll show you how RDI can help you transform slow data into fast data effortlessly so you can start syncing your existing database to Redis and scale operations seamlessly. Don’t miss out—register today. https://lnkd.in/gkKwpq7H

65

What is coming to PostgreSQL? According to this interesting article, these two big things. - Separation of Compute and Storage Meaning you will able to indepentily scale computing by adding new compute nodes, independely of the storage. Compute part is that logic that you definitely shouldn't be using in database /s - Pluggable Storage and Improved Table Engines You will be able just to plugin different storage types per table. For example column storage, graph storage, etc... It isn't farfetched to say that PostgreSQL could be the database that will end all other databases. At least it has that potential. So, get on board while you still can.

45

10 Comments

New blog post "Updating legacy Apache Airflow DAGs with Amazon Q Developer" I share my experiences on using Amazon Q Developer workspace context awareness to update some old Airflow workflows to get them running on the latest versions of Apache Airflow. Read about it at https://lnkd.in/ec6Q2VuN

12

3 Comments

PGConf NYC’s presentations span a wide variety of topics surrounding PostgreSQL. The conference will run 3 parallel tracks covering different technical levels to ensure there is always something interesting for everybody! https://buff.ly/49XC7Aa @PostgreSQL #PostgreSQL #postgres #pgconfnyc

3