Tanuja Korlepra

We are excited to announce the launch of Ursa engine, our Kafka API-compatible data streaming engine that is built on top of Lakehouse. Ursa is not something entirely new; it is built on our many years of experience building and operating #ApachePulsar and #ApacheKafka. To learn more about the #Ursa engine, I recommend our #PulsarSummit keynote presentation and announcement blog post. Here, I’d like to delve deeper into some of its features: 1. Making Kafka API a first-class citizen: In #ApachePulsar, we developed a unified messaging model combining queuing and streaming semantics into one protocol, aimed at enhancing data sharing between business applications. Although powerful and increasingly adopted by enterprises and unicorns, the requirement for application rewrites is impractical in today’s economy. Instead of building data gravity around a protocol, we open up access to the robust stream storage layer by extending support to the Kafka protocol, transitioning from a single protocol to a multi-protocol platform, facilitating greater flexibility and integration. 2. Achieve Stream-Table duality via Lakehouse Storage: Data streams commonly end up in data lakehouses, where integrating and maintaining them can be complex and resource-intensive. Ursa simplifies this by storing data streams as lakehouse tables in object storage. This integration not only streamlines operations but also allows seamless access to operational data for analytical processes. Thanks to its multi-modal storage engine which fosters data sharing across teams and departments. 3. Object storage as the primary storage solution: To better align with cloud economics, particularly for large workloads, Ursa makes ZooKeeper and BookKeeper optional and utilizes a cost-optimized write-ahead log based solely on object storage with leaderless and stateless brokers. This architecture leverages object storage for both data replication and storage, minimizing inter-AZ data transfers and reducing costs for latency-relaxed, high-volume workloads. By integrating these features at the multi-tenant level rather than at isolated cluster levels, Ursa eliminates costly data duplication and movement across clusters, allowing teams to map directly to tenants and be able to share data across teams and departments more efficiently. We believe that the future of data streaming platforms lies in being open and multi-faceted, fundamentally different from traditional data platforms. They are designed not just to store and process data, but to enhance organizational capabilities by fostering data sharing across the organization and integration with other systems. More and more data streaming platforms will look more like Ursa, with multi-protocol, multi-tenant, and multi-modal capabilities. Check out our announcement blog post about Ursa: https://lnkd.in/ghEKTYE6 #ApacheKafka #Lakehouse #DataStreaming

100

1 Comment

A few thoughts on #LLM usage in the small, prompted by my toying with #llama3 and #phi-3 on consumer hardware.

5

Had an opportunity to share my perspectives with AIthority on key trends in data management & data protection as it pertains to AI and highlight how NetApp is innovating and pushing the boundaries in this space. https://lnkd.in/gAhzpF4u #NetApp #DataScience #AI #DataManagement #IntelligentDataInfrastructure

83

Watch my conversation with Alan Shimel on Techstrong TV: https://techstrong.tv/ as we discuss the capabilities of Matt: The First Reliability Engineer. Webb.ai Chi Su Matthew Wirges Zachary Delagrange Akshay Dongaonkar Danny Martinsen #sre #devops #sitereliabilityengineering #sitereliabilityengineer #sitereliability #softwareengineering #cloudarchitect #staytuned Datadog Kubernetes

29

Learn how to secure and govern your LLMs with UAPIM so that you can safely implement these powerful AI and LLM models into your business.

1

Great read on our journey to securing your AI investments from Steph Hay and Umesh Shankar #1 - AI opens up a world of possibilities. Be proactive in securing your AI investments - data, models, applications, and infrastructure. #2 - Make Google part of your security team, and Security Command Center - Enterprise as your default platform to help secure your AI investments. #3 - New capabilities in Notebook Scanner (private preview) and Model Armor (previewing soon) to secure your AI investments. Shout out to Amit Patil, Bharath Chandrasekhar, Matt Driscoll, Bhaskar Annadata, Cfir Cohen, Rahul Venkatraj and many more for these new capabilities.

68

Whether you’re a developer or a business practitioner — #GenAI impacts everyone. Join Varun Grover and Distinguished Engineer Jayant Thomas to get advice on starting your #AI journey. Watch now: https://vrt.as/4a5vLzB

2

From Astrologer's Whispers to Real Connections: Reclaiming Belonging in a Lonely Age Have you ever consulted an astrologer, their predictions swirling in your head, only to feel empty when your day takes a different turn? The emptiness might not be about the details themselves, but about seeking outside approval for your happiness. This same feeling can creep in even when you achieve success. Remember climbing the career ladder, landing that dream apartment, only to find yourself lost in a quiet emptiness? In India's bustling cities, it's a familiar, painful emotion. We're surrounded by people, yet there's a little loneliness at the edges of our lives. Thinking back to Mrs. Deshmukh, your friendly neighbour with the legendary Til Gur Barfi's, who brought the whole neighbourhood together with tea and friendly chats. Those evenings of shared stories and laughter, a web woven by simple human connection, feel like a distant memory in our super-connected yet broken world. We chase success with thumbs glued to screens, building online bridges that leave us feeling more alone than ever. The pressure to create a perfect online self-drowns out the whispers of our own desires. But here's the real deal, that shiny designation and fancy car can't fill the hole left by genuine connection. There's hope, though! We can rewrite this story. Let's ditch the small talk and chase deeper connections. Share your fears and worries, break free from feeling isolated in this sea of ambition. Remember the warmth of family gatherings, the joy of shared childhood games? Revive those small traditions. Pick up the phone for a real heart-to-heart conversation rather than What's Apping. Every act of connection, no matter how ordinary, how small, builds a more satisfying life. Imagine hearing back from an old friend, reliving an old laugh, and being surrounded by people who truly see us, where we belong. Isn't that what life is all about? Together, one conversation, one meal, and one act of kindness at a time, we can tear down the walls of loneliness. We can rewrite the narrative of modern society, where connection becomes the foundation of a life well lived. It's not too late, or is it? #HumanConnections #BelongingMatters #OvercomeLoneliness #RealConversations #MeaningfulRelationships #CommunityOverConnectivity #AuthenticLiving #SocialWellbeing #RedefiningSuccess #TraditionsRewoven #FightIsolation #VulnerableAndReal #KindnessRevolution #SmallActsBigImpact #ReconnectingHumanity #IndianSociety #UrbanLoneliness #DigitalDetox #QualityOverQuantity #ConnectionCures Photo by Tim Marshall on Unsplash

9

What’s Next: RunWhen's Kyle Forster talks open source and microservices SDxCentral CEO Matt Palmer speaks with RunWhen's Kyle Forster about a better way for companies to support gigantic code bases.

2

Great meeting with the AWS ISV team at the AWS Summit! Engaged in insightful discussions with Jasjeet Singh , Sugandh Chaturvedi , Ravish Giri Ann Roberts and Leelavathi. We discussed key topics during the keynote and Gen AI tracks, focusing on the numerous improvements in AWS Bedrock. Exciting times ahead! 🚀 #AWSSummit #AWSISV #TechTalks

97

1 Comment

I wanted to share a quick 6 min long video I filmed on how to get started with AWS Amplify Gen 2. You will: 🔐 see how data and auth work, 🏖️ learn about deployment and sandboxes, ⚡️see how I can use Amazon Q to write code faster! https://lnkd.in/gpzqDvxd

64

3 Comments

Intuit’s VP, Global Data Krithika Swaminathan shares more about her career journey and her advice for aspiring leaders. "What’s stayed consistent in my entire career, especially at Intuit, is to lead with conviction and authenticity, to be bold, to never hesitate to ask for help, and to be as vulnerable as possible." Read more on Intuit Blog: https://bit.ly/4bKngtO

9

Today at 2PM CST, come by #BelieveInServerless to see a wonderful talk about saving money on AWS with Serverless. Rakesh Sanghvi is a great friend and knows his stuff when it comes to cost savings. So much to learn from this one! https://lnkd.in/g7n8Xp2d

9

In a recent pivotal discussion hosted by The Atlantic, leaders from IBM, Meta, and the Partnership on #AI explored the critical importance of integrating ethics into the advancement of AI technologies. The dialogue emphasized that open-source AI must be leveraged not just for innovation, but to ensure that new technologies are safe, inclusive, and universally beneficial. This gathering highlighted the shared responsibility among industry leaders to foster AI developments that prioritize human welfare and ethical standards. These efforts are essential in ensuring that AI technologies enhance lives while safeguarding core societal values. Discover more about how these leaders are driving a movement towards responsible and human-centered AI. Two strong leaders and advocates in this space: Myriam Côté, eng., Ph.D. and Yoshua Bengio. Also check out Mila - Quebec Artificial Intelligence Institute / IVADO and https://lnkd.in/dXWpvmgU. #AI #EthicalAI #HumanityInTech #OpenSourceAI #IBM #Meta #PartnershipOnAI #TechnologyForGood #DigitalTransformation #AIforGood #AIforHumanity

10

Introducing the Google Cloud Private Marketplace, now generally available. Private Marketplace allows cloud administrators to create a curated collection of vetted software and solutions that integrate with Google Cloud and align with your organization’s cost, security, and compliance policies. Empower your end users to explore pre-approved tools without compromising on governance and cost control. Read the blog to learn more. #GoogleCloudMarketplace #GCP #GoogleCloud #Marketplace #Software

1

I'm feeling accomplished after completing the "Executive Presence and Influence" course as part of the Wharton Executive Education | CTO Program. 🎓 The rapidly evolving business landscape demands executives who can mobilize teams and deliver impact. This course provided invaluable tools to develop an influential executive presence along with fantastic networking opportunities. Through personal growth exercises, building a diverse professional network, and mastering persuasive communication techniques, I've gained the skills to shape opinion and rally people around my vision. I'm energized to leverage my heightened executive presence and influencing capabilities. Here's to embracing challenges, inspiring others, and achieving ambitious goals! 💪 #WhartonCTO #ExecutivePresence

45

4 Comments

Really fun conversation with Joe Reis 🤓 on a variety of topics across the evolution in data architecture patterns, open table formats, the growing preference for object stores and data lakehouses. And of course the fun bits and challenges of building a company in the data infrastructure space. I've always enjoyed Joe's informal, no nonsense, common sense approach to making sense of the data world and was super kicked to have this conversation! #dataengineering #datalake Apache Iceberg Apache Hudi Delta Lake Apache XTable (Incubating)

37

1 Comment

Does your organization struggle with aligning their work processes and prioritizing tasks efficiently? Join Kim Binette from State Street at our VSM Summit in a session on Optimizing Efficiency with Value Streams. Learn how to implement Value Stream Management (VSM) to reduce noise and prioritize high-value signals, ensuring alignment and efficiency across your programs and projects. Register now to learn from Kim Binette, Brian Nathanson and other industry leaders at our VSM Summit: https://lnkd.in/dr3QuwQt #ValueOpsVSM #ValueStreamManagement #DigitalTransformation

4