📢We are thrilled to announce the release of Apache Doris 2.1.0! For our long-term supportive users, allow me to re-introduce Apache Doris with its amazing new features and substantially improved data writing and query performance! For those who are new to Apache Doris, this is great timing for a proof of concept to see how it performs in your use case! Fasten up and be ready for: 🚶♂️ 100% faster out-of-the-box performance proven by TPC-DS benchmark tests 🚶♀️ Improved data lake analytics capabilities: 4~6 times faster than Trino and Spark 🏃♂️ Solid support for semi-structured data analysis 🏃♀️ Materialized view across multiple tables to accelerate multi-table joins 💃 Enhanced real-time writing efficiency powered by AUTO_INCREMENT column, AUTO PARTITION, forward placement of MemTable, and Group Commit. 🕺 Better workload management for higher performance stability https://lnkd.in/gjVXD6gQ #database #dataengineering #analytics #bigdata #opensource
Apache Doris
Software Development
San Francisco, California 1,906 followers
Apache Doris is an open-source real-time data warehouse based on MPP architecture.
About us
Apache Doris is an open-source real-time data warehouse based on MPP architecture, known for its fast speed and ease of use. It supports real-time data ingestion and real-time query response in both high-concurrency point query and high-throughput analysis scenarios. With it, users can process and analyze large datasets in the blink of an eye. In June 2022, Apache Doris became a full-fledged, top-level project incubated by ASF. It accumulated nearly 600 contributors and more than 20,000 developers are using Apache Doris today. Doris is also used in production within over 2000 companies around the world, trusted by business giants such as AWS, Fuse, JD.com, Lenovo, OPPO, Shoppe, TikTok, Tencent, Vivo, Xiaomi and etc. We welcome more open source technology enthusiasts to join the Apache Doris community and together discover infinite possibilities! Learn more about Apache Doris on Github: https://github.com/apache/doris Join the Apache Doris community on Slack: https://join.slack.com/t/apachedoriscommunity/shared_invite/zt-2gmq5o30h-455W226d79zP3L96ZhXIoQ
- Website
-
https://doris.apache.org/
External link for Apache Doris
- Industry
- Software Development
- Company size
- 201-500 employees
- Headquarters
- San Francisco, California
- Type
- Nonprofit
- Founded
- 2018
Locations
-
Primary
San Francisco, California 94102, US
-
Beijing, Beijing 100086, CN
Updates
-
Why Apache Doris is worth taking a look at as a #log analysis solution❓ 🏠 Storage efficiency: Only requires 144GB of space to store 1TB raw log data. ✍️ Write throughput: Reaches a write speed of 500MB/s when ingesting 1TB log data with a cluster of 3 machines (16 Core, 64 GB each). (Dataset from Log and Telemetry Analytics #Benchmark by Microsoft #Azure) 📄 Text search: Provides inverted index that is fine-grained to the row, enabling efficient full-text searching. 🥪 Aggregation: A C++-based vectorized execution engine and MPP distributed architecture to enable high performance. 🧑💼 Well-established distributed cluster management 🕸️ Seamless online scaling 🦑 High cluster availability #opensource #Elasticsearch #ClickHouse #database #bigdataanalytics
-
-
Always nice to see approachable and easy-to-follow guides for data engineering beginners. 👍 After introducing how to build your first data platform using MySQL, Apache Doris, and Apache Flink, Mohamed Amine Turki moves a little upstream and explains on Change Data Capture (CDC) with step-by-step instructions. https://lnkd.in/g9igQNjY (P.S. Apache Doris provides a Flink-Doris-Connector with built-in CDC support: https://lnkd.in/gmPESd3V) #dataengineering #beginner #Flink #CDC
Data Platform 101: Change Data Capture
dataplatformhub.medium.com
-
Just updated our doc to provide an overview of the Apache Doris capabilities in log storage and analysis. You will learn about: 💪 What makes the Apache Doris solution stand out 🛠 How to build a log analytic platform with Apache Doris https://lnkd.in/gr2nZ9-S #Filebeat #Logstash #fluentd #fluentbit #Kafka #Grafana #Superset #log #database
-
-
Comparing Elasticsearch with Apache Doris: Part 2️⃣ #loganalysis #fulltextsearch #aggregation #joinquery #database
-
-
Comparing Elasticsearch with Apache Doris: Part 1️⃣ #loganalysis #invertedindex #database
-
-
🤔 Why Asynchronous Materialized View? 1️⃣ Direct queries on the MV instead of complicated queries on base tables 2️⃣ Auto-rewrite #SQL for optimal execution 3️⃣ Create MVs on external tables for #datalakehouse usage 4️⃣ Accelerate E2E #dataprocessing 5️⃣ Lightweight #datamodeling 🌤 Future plans: 🌱 Stream ETL 🌱 Stream Build 🌱 AIOps https://lnkd.in/g7aUbtQb
-
-
A little preview of the next big release of Apache Doris 👀 : It will support the compute-storage decoupled mode. #cloudcompute #database #dataengineering #opensource #S3 #HDFS #MinIO
-
-
Apache Doris reposted this
Rockset VS VeloDB Cloud: a comparison of their features and use cases VeloDB is the commercial provider of Apache Doris, a competent open source alternative to Rockset. https://lnkd.in/g6Fn7npi VeloDB Cloud provides cloud-native real-time data analytics services with schemaless support. It is compatible with the MySQL protocol and delivers high data ingestion and querying speed. Start your free trial: https://lnkd.in/gUWMgW73 Or book a call with us for further information: contact@velodb.io #RocksetAlternative #OpenAI #database #analytics #BigData #dataengineering
-
-
"While going through some data platform designs shared by companies like Uber and Netflix can be both exciting and intimidating, becoming a data platform engineer is actually much more accessible than these articles might suggest." This is a guide on building a simple data platform with three basic components: 🚢 MySQL 🚢 Apache Doris 🚢 Apache Flink Kudos to Mohamed Amine Turki for the hands-on instructions. This would make a great stepping stone for someone who's new to data engineering. #dataengineering #database #MySQL #ApacheFlink #opensource https://lnkd.in/gYq2JbKQ
Build Your First Data Platform: A Beginner’s Guide
dataplatformhub.medium.com