Sunita Mishra, left, chief medical officer at Amazon Health Services, listens as Katrina Armstrong, right, dean of Columbia's Faculties of Health Sciences and the Vagelos College of Physicians and Surgeons, speaks at an October 2023 symposium hosted by Columbia University. Both are sitting, Katrina is holding a mic and gesturing with her left hand, there is also a person somewhat visible in the foreground.
Sunita Mishra, left, chief medical officer at Amazon Health Services, listens as Katrina Armstrong, right, dean of Columbia's Faculties of Health Sciences and the Vagelos College of Physicians and Surgeons, speaks at an October 2023 symposium hosted by Columbia University.

How Amazon and Columbia University are collaborating to advance AI in healthcare

Amazon Health Services' Sunita Mishra and Columbia University’s Katrina Armstrong discuss technology's potential role in medical settings.

Since 2020, Amazon and Columbia University have worked together on challenges in artificial intelligence (AI) through the Columbia Center of Artificial Intelligence Technology. The collaboration extends to healthcare, where AI can lend support to both clinicians and patients. In October 2023, the university hosted a symposium that fostered conversations about the role of AI in healthcare, including how to enable trustworthy and responsible technology.

Sunita Mishra, chief medical officer at Amazon Health Services, and Katrina Armstrong, dean of Columbia's Faculties of Health Sciences and the Vagelos College of Physicians and Surgeons, recently shared their thoughts on how AI could change healthcare for the better.

  1. Q. 

    How are Amazon and Columbia University collaborating on healthcare issues?

    A. 

    Mishra: At Amazon Health Services, our mission is to make it easier for people to find the products and services that they need to get and stay healthy. We believe that the experience of accessing care just needs to be a lot easier. Collaborating with one of the nation's top-tier universities is a great opportunity to expand our exploration of artificial intelligence and large language models as tools for some of the things that we're setting out to do.

    Armstrong: We share a very clear commitment to using digital tools to improve access, quality, and equity in healthcare. Building upon existing partnerships with the engineering school here, Amazon and Columbia have an opportunity to develop new ways to study how we can improve healthcare access with digital tools; to understand the ways to build trust and enhance communication; and to really become a model of a partnership between an academic medical center, a university, and a tech giant that is able to disseminate the knowledge we can create to almost everyone.

  2. Q. 

    What does each side bring to the table?

    A. 

    Armstrong: We at Columbia bring this innovative energy of young, bright physicians and scientists who are actually at the front lines of healthcare issues. And then Amazon has an extraordinary ability to think broadly about how to scale their incredible vision for what it can mean to create a digital world that we all live in. Any great idea that we can co-develop has the opportunity to have the greatest possible impact.

    Mishra: Collaborations like this one with Columbia are not unusual at Amazon, and they're valuable, because they open up the opportunity to collaborate with people or institutions that have a whole different set of expertise than we do. At the symposium in October, there were participants from Columbia's medical college, their business school, and their engineering school. To be there with people who were all looking at a similar area with a different lens was super energizing.

  3. Q. 

    How can AI help solve problems in healthcare?

    A. 

    Mishra: AI is among the most transformational technologies of our time, and I believe generative AI can support the transformation of the healthcare experience. One of the areas I am most interested in is how we can use artificial intelligence tools and large language models to make the job of the clinician easier. This would allow clinicians to spend more time building relationships with patients and not on the administrative tasks that we know can take up nearly 50 percent of their day.

    At Amazon Pharmacy, we have applied large language models to improve the transparency of price so you're never surprised by the cost of what you've been prescribed. That approach would be really valuable in other aspects of care, where you could help people understand what their copay is or how much of their deductible is remaining.

    At the symposium, the team at Columbia brought up that we could use predictive analytics to really understand the waxing and waning of demand from patients and use that to make sure we're staffed up appropriately.

    Armstrong: Over the last 30 years in medicine and in science, we've made amazing advances in what we can offer patients. The problem is, we haven't been able to get all of that out to the people who really need it. So what we've been thinking about for the last decade is, how do we take these tools and create new models that are going to get everybody access to the information they need to make the right decisions and then build upon that with new models of delivery?

    Recently there was a new gene therapy approved for sickle cell anemia. Imagine if we could create tools that identify and inform candidates for treatment. Then we could use AI and other tools to identify how best to do that, to follow patients, and to make better decisions as we go forward.

    So that's what I'm excited about. It's not AI on its own. It's really about how this helps us address this fundamental crisis that's driven me forever, which is: Why on Earth can't we help more people?

  4. Q. 

    How do you see AI's role evolving in healthcare?

    A. 

    Armstrong: We have faculty who have been studying, working, and living everything about AI for decades. What is remarkable now is that we've democratized it. So, as opposed to a small group of individuals testing and advancing it, we're at this point where AI in healthcare is becoming something that we're thinking about across every aspect of what we do.

    My sense is that we are going to see many parts of healthcare — particularly how we manage and use data — move fairly quickly to better models, whether that's how we collect information from patients, how we provide information to patients, or how we use that information for quality and safety efforts in hospitals and physician practices.

    I think it's going to take longer for it to really become part of how we do medical education, which is where I spend a lot of time. And it's going to take some really Innovative people to come up with ways that AI truly transforms our ability to address the fundamental challenges of healthcare access, quality, and cost. That's going to take some big, bold moves.

    Mishra: The potential is huge; AI is a very powerful tool, and in many ways, Amazon is already improving customers’ lives with practical, useful generative AI innovations. When it comes to AI in healthcare, I'm optimistic about it, and I have been impressed with the care and thought with which people in the industry are approaching solutions.

    Amazon is a place where you can make a significant impact on the lives of customers, and to be able to help make it easier for people to engage with their health is tremendously meaningful work. Most primary care clinicians will see their patients a couple of times a year. We have people who visit the Amazon Store much more frequently. That relationship gives us an opportunity to surface things that are important for their health and to close care gaps. For example, what if we could remind people about checkups or screenings that they may be due for, or just make it easier to schedule appointments or refill their prescriptions? That will make a huge difference. That's what gets me out of bed every day.

Related content

US, NY, New York
AWS AI is looking for passionate, talented, and inventive Applied Scientists with a strong machine learning background to help build industry-leading Conversational AI Systems. Our mission is to provide a delightful experience to Amazon’s customers by pushing the envelope in Natural Language Understanding (NLU), Dialog Systems including Generative AI with Large Language Models (LLMs) and Applied Machine Learning (ML). As part of our AI team in Amazon AWS, you will work alongside internationally recognized experts to develop novel algorithms and modeling techniques to advance the state-of-the-art in human language technology. Your work will directly impact millions of our customers in the form of products and services that make use language technology. You will gain hands on experience with Amazon’s heterogeneous text, structured data sources, and large-scale computing resources to accelerate advances in language understanding. We are hiring in all areas of human language technology: NLU, Dialog Management, Conversational AI, LLMs and Generative AI. About the team Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. Hybrid Work We value innovation and recognize this sometimes requires uninterrupted time to focus on a build. We also value in-person collaboration and time spent face-to-face. Our team affords employees options to work in the office every day or in a flexible, hybrid work model near one of our U.S. Amazon offices.
US, WA, Seattle
An information-rich and accurate product catalog is a strategic asset for Amazon. It powers unrivaled product discovery, informs customer buying decisions, offers a large selection, and positions Amazon as the first stop for shopping online. We use data analysis and statistical and machine learning techniques to proactively identify relationships between products within the Amazon product catalog. This problem is challenging due to sheer scale (billions of products in the catalog), diversity (products ranging from electronics to groceries to instant video across multiple languages) and multitude of input sources (millions of sellers contributing product data with different quality). Amazon’s Item and Relationship Identity Systems group is looking for an innovative and customer-focused applied scientist to help us make the world’s best product catalog even better. We believe that failure and innovation are inseparable twins. In this role, you will partner with technology and business leaders to build new state-of-the-art algorithms, models, and services to infer product-to-product relationships that matter to our customers. You will work in a collaborative environment where you can experiment with massive data from the world’s largest product catalog, work on challenging problems, quickly implement and deploy your algorithmic ideas at scale, understand whether they succeed via statistically relevant experiments across millions of customers. Key job responsibilities * Map business requirements and customer needs to a scientific problem. * Align the research direction to business requirements and make the right judgments on research/development schedule and prioritization. * Research, design and implement scalable machine learning (ML), natural language, or computational models to solve problems that matter to our customers in an iterative fashion. * Mentor and develop junior applied scientists and developers who work on data science problems in the same organization. * Stay informed on the latest machine learning, natural language and/or artificial intelligence trends and make presentations to the larger engineering and applied science communities.
US, CA, San Diego
Are you passionate about automation, knowledge extraction, and artificial intelligence through the use of Machine Learning, Natural Language Processing, Recommender systems, Computer Vision, and Optimization? We have a team of experienced scientists with a critical business mission making revolutionary leaps forward in these spaces. On this team you will work with an immense and diverse corpus of text, image, and audio to build generative and discriminative models, analyze and model customer reading behavior to measure engagement and detect risks, study and optimize manufacturing and fulfillment processes, and build AI-based systems for helping indie authors with marketing their books. This will involve combining methods from several science domains with domain knowledge across multiple businesses into sophisticated ML workflows. Our team has mature areas and green-field opportunities. We offer scientific autonomy, value end-to-end ownership, and have a strong customer-focused culture. Come join us as we revolutionize the book industry and deliver an amazing experience to our Kindle authors and readers. Key job responsibilities As a Machine Learning Scientist at Amazon, you will connect with world leaders in your field working on similar problems. You will be working with large distributed systems of data and providing technical leadership to the product managers, teams, and organizations building machine learning solutions. You will be tackling Machine Learning challenges in Supervised, Unsupervised, and Semi-supervised Learning; utilizing modern methods such as deep learning and classical methods from statistical learning theory, detection, estimation. MLS’s are specialists with the knowledge to help drive the scientific vision for our products. They are externally aware of the state-of-the-art in their respective field of expertise and are constantly focused on advancing that state-of-the-art for improving Amazon’s products and services. Great candidates for this position will have experience in the areas of data science, machine learning, NLP, optimization, computer vision, or statistics. You will have hands-on experience with multiple science initiatives as well as be able to balance technical strength with business judgment to make decisions about technology, models and methodological choices. You will strive for simplicity, and demonstrate significant creativity and high judgment. About the team Kindle Direct Publishing (KDP) and Print-On-Demand (POD) have empowered a new wave of self-motivated creators, tearing down barriers that once blocked writers from reaching readers. Our team builds rich applications that empower anyone to realize their dream of becoming an author. We strive to provide an experience that is powerful, simple, and accessible to all. We build tools that enable authors to design high quality digital and print books, reaching readers all around the world. This role will help ensure we maintain the trust of both our Authors and Readers by ensuring all books published to Amazon meet our standards.
US, CA, Sunnyvale
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Applied Scientist with a strong deep learning background, to help build industry-leading technology with multimodal systems. Key job responsibilities As an Applied Scientist with the AGI team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with multimodal systems. Your work will directly impact our customers in the form of products and services that make use of vision and language technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate development with multimodal Large Language Models (LLMs) and Generative Artificial Intelligence (GenAI) in Computer Vision. About the team The AGI team has a mission to push the envelope with multimodal LLMs and GenAI in Computer Vision, in order to provide the best-possible experience for our customers.
US, WA, Seattle
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to help Amazon provide the best customer experience by preventing eCommerce fraud? Are you excited by the prospect of analyzing and modeling terabytes of data and creating state-of-the-art algorithms to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you enjoy collaborating in a diverse team environment? If yes, then you may be a great fit to join the Amazon Buyer Risk Prevention (BRP) Machine Learning group. We are looking for a talented scientist who is passionate to build advanced algorithmic systems that help manage safety of millions of transactions every day. Key job responsibilities Use machine learning and statistical techniques to create scalable risk management systems Learning and understanding large amounts of Amazon’s historical business data for specific instances of risk or broader risk trends Design, development and evaluation of highly innovative models for risk management Working closely with software engineering teams to drive real-time model implementations and new feature creations Working closely with operations staff to optimize risk management operations, Establishing scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation Tracking general business activity and providing clear, compelling management reporting on a regular basis Research and implement novel machine learning and statistical approaches
US, WA, Seattle
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to help Amazon provide the best customer experience by preventing eCommerce fraud? Are you excited by the prospect of analyzing and modeling terabytes of data and creating state-of-the-art algorithms to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you enjoy collaborating in a diverse team environment? If yes, then you may be a great fit to join the Amazon Buyer Risk Prevention (BRP) Machine Learning group. We are looking for a talented scientist who is passionate to build advanced algorithmic systems that help manage safety of millions of transactions every day. Key job responsibilities Use machine learning and statistical techniques to create scalable risk management systems Learning and understanding large amounts of Amazon’s historical business data for specific instances of risk or broader risk trends Design, development and evaluation of highly innovative models for risk management Working closely with software engineering teams to drive real-time model implementations and new feature creations Working closely with operations staff to optimize risk management operations, Establishing scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation Tracking general business activity and providing clear, compelling management reporting on a regular basis Research and implement novel machine learning and statistical approaches
US, WA, Bellevue
Do you want to work on a team where you are encouraged to build and have the autonomy to push boundaries? Invention has become second nature at Amazon, and the pace of innovation is only accelerating with breadth of our businesses expanding. Amazon’s growth requires leaders who move fast, have an entrepreneurial spirit to create new products, have an unrelenting tenacity to get things done, and are capable of breaking down and solving complex problems. The AIM, Planning team within SCOT comprises of S&OP, Inventory Prediction and Entitlement and Long-Term Capacity and Topology Planning. The team's charter is broad and complex and aimed at optimizing the utilization of fulfillment facilities and resources by accurately predicting demand and inventory efficiency measures while reducing stockouts and excess inventory costs across planning horizons, from short-term (within 13 weeks) to the long-term (13 weeks to 5 years). The team's north star is to be the reliable, single source of truth for inventory units and cube demand at granularities ranging from an FC’s bins to overall network level, and across planning horizons as close as next week to as far out as 3-5 years. To get there, we enhance or re-develop models and mechanisms where existing ones fail to account for structural shifts in supply chains, buying programs, or customer behaviors. We create new systems where science-based recommendations are currently lacking and being replaced by heuristics and offline human goal-seeking approaches. We strive to completely eliminate non-scientific interventions in our forecast guidance and capacity recommendations, and replace them with a system-driven outlook to uncover underlying root causes when departing from SCOT plans and recommendations. We institute authoritative and economics-based framework missing today to drive inventory efficiency measures for Retail buying programs (short/long-lead buys) and FBA plans that solve for capacity constraints in the most economical manner across horizons. This is a unique, high visibility opportunity for a senior science leader someone who wants to have business impact, dive deep into large-scale economic problems, enable measurable actions on the Consumer economy, and work closely with product managers, engineers, other scientists and economists. We are a Day 1 team, with a charter to be disruptive through the use of ML and bridge the Science and Engineering gaps that exist today. A day in the life In this pivotal role, you will be a technical leader in operations research or machine learning, with significant scope, impact, and visibility. Your solutions have the potential to drive billions of dollars in impact for Amazon's supply chain globally. As a senior scientist manager on the team, you will engage in every facet of the process—from idea generation, business analysis and scientific research to development and deployment of advanced models—granting you a profound sense of ownership. From day one, you will collaborate with experienced scientists, engineers, and product managers who are passionate about their work. Moreover, you will collaborate with Amazon's broader decision and research science community, enriching your perspective and mentoring fellow engineers and scientists. The successful candidate will have the strong expertise in applying operations research methodologies to address a wide variety of supply chain problems. You will strive for simplicity, demonstrate judgment backed by mathematical rigor, as you continually seek opportunities to innovate, build, and deliver. Entrepreneurial spirit, adaptability to diverse roles, and agility in a fast-paced, high-energy, highly collaborative environment are essential.
US, WA, Bellevue
We are a part of Amazon Alexa organization where our mission is “delight customers through contextual and personalized proactive experiences that keep customers informed, engaged, and productive without cognitive burden”. We are developing advanced systems to deliver engaging, intuitive, and adaptive content recommendations across all Amazon surfaces. We aim to facilitate seamless reasoning and customer experiences, surpassing the capabilities of previous machine learning models. We are looking for a passionate, talented, and resourceful Senior Applied Scientist in the field of Natural Language Processing (NLP), Large Language Model (LLM), Recommender Systems and/or Information Retrieval, to invent and build scalable solutions for a state-of-the-art context-aware personal assistant. A successful candidate will have strong machine learning background and a desire to push the envelope in one or more of the above areas. The ideal candidate would also enjoy operating in dynamic environments, be self-motivated to take on challenging problems to deliver big customer impact, shipping solutions via rapid experimentation and then iterating on user feedback and interactions. Key job responsibilities As a Senior Applied Scientist, you will leverage your technical expertise and experience to demonstrate leadership in tackling large complex problems, setting the direction and collaborating with applied scientists and engineers to develop novel algorithms and modeling techniques to enable timely, relevant and delightful recommendations and conversations. Your work will directly impact our customers in the form of products and services that make use of various machine learing, deep learning and language model technologies. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in the state of art.
US, WA, Bellevue
We’re building the speech and language solutions behind Alexa. We’re working hard, having fun, and making history; come join us! Amazon is looking for a Language Data Scientist to join our Language Science, Engineering and Research team. We are seeking a candidate with strong analytical skills, solid linguistics domain expertise, and Machine Learning experience to help us measure, analyze and solve complex problems. In this role, you are responsible for the design and delivery of LLM products using your linguistic, machine learning, and data analysis skills to understand what a customer meant. You are a key member in new feature development while proactively improving existing experiences. You work closely with linguists, scientists, engineers, and product managers, to deliver magical experiences that customers love. Key job responsibilities * Design, develop, and implement innovative NLP solutions to address large-scale qualitative and quantitative data needs * Streamline the development and evaluation process for LLMs with a focus on customer requests (text, speech, etc.) * Collaborate with engineers, scientists and linguists to ensure models are effective, accurate, and aligned with business goals * Conduct research and stay current on the latest advancements in NLP and machine learning * Analyze the interpret NLP model outputs, providing actionable insights to stakeholders * Document and present findings in a clear and concise manner
US, WA, Bellevue
Amazon is seeking an exceptional Applied Science Manager to join AGI Info Content team. In this role, you will be at the forefront of developing and enhancing the intelligence of AmazonBot crawler and content processing. The team is a key enabler of Amazon's AGI initiatives such as data pipelines for Olympus model training and collecting data for AGI Info grounding services. Our systems operate on web scale. This requires great combination of innovation to utilize all SOTA ML techniques in combination with model optimization to operate on 100k+ requests/decision per second. Your work will directly impact the quality and efficiency of our data acquisition efforts, ultimately benefiting millions of customers worldwide. Key job responsibilities - Design, develop, and implement advanced algorithms and machine learning models to improve the intelligence and effectiveness of our web crawler and content processing pipelines. - Collaborate with cross-functional teams to identify and prioritize crawling targets, ensuring alignment with business objectives - Analyze and optimize crawling strategies to maximize coverage, freshness, and quality of acquired data while minimizing operational costs as well as dive deep into data to select the highest quality data for LLM model training and grounding. - Conduct in-depth research to stay at the forefront of web acquisition and processing. - Develop and maintain scalable, fault-tolerant systems to handle the vast scale of Amazon's web crawling operations - Monitor and analyze performance metrics, identifying opportunities for improvement and implementing data-driven optimizations - Mentor and guide junior team members, fostering a culture of innovation and continuous learning