Apache Doris’ Post

Comparing Elasticsearch with Apache Doris: Part 2️⃣ #loganalysis #fulltextsearch #aggregation #joinquery #database

Follow this easy tutorial where our own Sébastien Blanc shows you how to capture data changes from MySQL to Apache Kafka using Debezium. Check it out here 👉 https://lnkd.in/dXAatGUU

A use case to show you how Apache Doris can be used as a unified OLAP platform. 🏌♀️The user previously used Kylin and MySQL for reporting, and ClickHouse and Presto for ad-hoc analysis. They then put these workloads with Apache Doris and increase processing efficiency by 3 times 🕴Use Apache Doris to accelerate offline data lakehouse (Hive and Iceberg), 3 times faster than Presto and 10 times faster than Hive ⛹♂️Use Apache Doris for incremental data processing, 8 times faster than Spark 🧗♂️Daily data addition of 10 billion rows, single-replica storage of 10TB, 8000 Apache Doris servers in total #database

If you are looking for some insight on capturing data changes from #mysql to #kafka using #debezium then join this session. #data #aiven #confluent

Apache Doris 2.1.4 is available now! 📣 It is optimized in terms of data lakehouse capabilities, query optimizer, and asynchronous materialized view, with higher usability and stability in query execution, semi-structured data analysis, Unique Key model, data ingestion/control, memory management, and privilege management. Just to list a few of the key improvements: 🎈The new query optimizer now supports high-concurrency point queries. 🎈Support native reader of Apache Paimon deletion vector, which largely improves data update/deletion efficiency. 🎈Access controller supports Data Mask with Hive Ranger plugin 🎈Support for transparent rewriting in single-table asynchronous materialized views 🎈Support fetching file lists of Hive/Hudi tables in batches (The list fetching latency for 1.2 million files has reduced from 390s to 46s.)  ... Read more: https://lnkd.in/gr2nAd5F #opensource #database #dataengineer #bigdata #datalakehouse #OLAP #ApacheSoftwareFoundation

Transform postgres to a vector database with its pgvector extension to run approximate nearest neighbor and find similar vectors of a given one super fast with traditional sql even in billions! 🎥 https://lnkd.in/eYgChrxx #machinelearning #deeplearning

POSTGRES -> ICEBERG -> DASHBOARD Get hands on with me in this video where we seed some data in Postgres, ingest it into Iceberg with Dremio and building and connect to Apache Superset to build Dashboards. Dremio Hands-on: Ingesting Postgres Data into Apache Iceberg and Serving a Dashboard https://lnkd.in/eJ3H4tUc #DataEngineering #DataLakehouse #ApacheIceberg #ApacheSuperset #BIDashboards

Just completed Board light from #HackTheBox i learned a lot from this machine and it covers all about subdomain enumeration, finding public exploits, MySQL database, Privilege Escalation using SUID and much more 😎 #htb

Exploring the Uncharted Territories of Apache Projects 😀 While diving into the vast sea of Apache projects, I stumbled upon some gems that are not as widely recognized but hold immense potential. Here’s a brief overview: - Apache APISIX: A dynamic, real-time API gateway, providing rich traffic management features. https://apisix.apache.org/ - Apache ShardingSphere: An ecosystem of distributed database solutions catering to data sharding, distributed transactions, and database orchestration. https://lnkd.in/dTNBx4Ze - Apache SeaTunnel: A distributed and high-performance data integration platform for massive data processing. https://lnkd.in/duc_mWPm - Apache SkyWalking: An observability analysis platform and application performance monitor (APM) system. https://lnkd.in/dC6WAfsU - Apache Doris: A modern, easy-to-use MPP analytical data warehouse for near-real-time analytics. https://doris.apache.org/ 🔗 Read more about these projects here: https://lnkd.in/dTNiVpeB #technology #apache #data #computerprogramming

Did you know? Virtual indexes in PostgreSQL can be a game-changer for query optimization. They simulate real indexes, helping you to assess performance improvements without permanent changes. Try it out! #PostgreSQLPerformance #IndexSimulation #EfficientDBA #PostgreSQLTips