Research: AI performance in medical imaging is ‘worse than random’

Study: GenZ isn’t so big into AI 👎️ 

🤝 ChatGPT for marketing campaigns

👀 Quick Links

📊 Funding & New Arrivals

• Swiss startup EthonAI — focusing on making sense of manufacturing data — raised $16.5 million in Series A funding.

• WeaveBio, an AI-powered life sciences platform, announced $10 million in seed funding.

• Enterprise AI company Cloudera is acquiring self-described “generative AI workbench” Verta.

🖥️ AI tools for work:

Tabnine: Accelerate your development with Tabnine, the AI coding assistant you control. Ensure your code stays private and protected with licensed models. Enjoy personalized recommendations tailored to your needs. (link)

💰Jobs in AI:

• Generative AI Engineer: Ascendion · United States · New Jersey; Hybrid · Full-time · (Apply here)

• Data Scientist: GitAI · United States · Torrance, CA · Full-time · (Apply here)

• AI Researcher: Peraton · United States · Fort Meade, MD · Full-time · (Apply here)

Together with Superhuman

Superhuman — the fastest email experience ever made — now has AI built-in.

Now with Ask AI, you can immediately get answers from your inbox.

Just ask: “Where is the q2 offsite”, or “summarize recent Deep View newsletters.”

What took minutes now takes seconds.

Stop searching, start asking with Superhuman AI.

Sign up for free beta access through our partnership.

Get early access to Ask AI with Superhuman

Research: AI performance in medical imaging is ‘worse than random’

A big issue in the AI industry has to do with poor methods of evaluation, which helps developers over-sell models and can convince users to deploy models in situations where they maybe shouldn’t. 

Researchers at the University of California, Santa Cruz, are seeking to introduce more robust methods of evaluation specifically for large multimodal models (LMMs). A recent paper (that hasn’t yet been peer-reviewed) evaluated a series of LMMs in the field of medical visual question answering. And the models didn’t hold up.

• You can read the full paper here. 

Key findings: The study found that top models — such as Gemini Pro — “perform worse than random guessing” on specialized diagnostic questions, which highlights “significant imitations” of the LMM architecture. 

• The researchers tested models by introducing hallucination pairs to double-check the model’s ability to answer a question. An example of this is shown in the image below. 

• The seven models tested experienced between a 10% and 78% reduction in accuracy when tested more intensely. 

“These findings underscore the urgent need for robust evaluation methodologies to ensure the reliability and accuracy of LMMs in medical imaging,” the report reads. 

The findings are summarized in this quick thread from one of the lead researchers.

Together with Brilliant

Unlock your AI potential

We talk a lot about two things here: Large Language Models (LLMs) and the steadily growing adoption of AI technology across global industries and businesses. 

The task of understanding LLMs & the concepts behind them, however, is often a challenging one. But that’s where Brilliant comes in. 

Offering bite-sized, personalized courses in everything from math to coding to LLMs, you can dive into the world of AI (at your own pace) and develop real, actionable knowledge in each of these critical areas. 

It’s fun, it’s interactive, and, most importantly, it’s easily accessible.

With Brilliant, you won’t get left behind by the boom of the AI craze. 

Join 10 million other proactive learners around the world and start your 30-day free trial today. Plus, readers of AI For Work get a special 20% off a premium annual subscription.

Study: GenZ isn’t so big into AI 

A recent study – conducted by Hopelab, Common Sense Media and The Center for Digital Thriving at Harvard Graduate School of Education – of the younger generation’s impression of generative AI found that the kids aren’t wholly sold on the tech. 

• The survey of 1,274 young people (ages 14-22) was conducted in November 2023. 

Key findings: Half of those surveyed have used generative AI at some point in their lives

• But only 4% are daily users. 

• 41% have never used AI tools & 8% don’t know what AI tools are. 

A third of those who stay away from AI just don’t believe it will be helpful for them. But 23% don’t know how to use them and 22% are concerned about issues with privacy. 

• The bulk of kids who do use genAI use it to get information, brainstorm ideas and for homework help. 

"As generative AI continues to evolve, it is essential that the voices and experiences of young people are included in developing these tools and how they will transform many aspects of our society," Amy Green, Head of Research at Hopelab, said.

Why it matters: With U.S. policy on AI still lagging the pace of deployment, and AI tools making their way to schools even as they transform the internet, the impressions of the people expected to best adapt to the technology are an important consideration. 

ChatGPT use case 🤝 

AI for Content Creation

How It Works:

This AI aids content creators by generating high-quality articles, blog posts, and social media content, thus enhancing productivity and consistency.

Why Use It:

Tailored to elevate content creation, it offers tools for brainstorming ideas, drafting content, and optimizing text for SEO. Content creators can use AI to produce engaging material quickly, maintain a consistent publishing schedule, and reach their target audience effectively.

Prompt Example:

"Generate a blog post about [Topic] targeting [Audience Type]. Include key points on [Subtopic 1], [Subtopic 2], and [Subtopic 3]. Optimize the content for SEO with relevant keywords, and provide a conclusion summarizing the main insights and a call-to-action for [Desired Action]."

Thank You For Reading!

See you next edition!

-The AI For Work Team
Find Me On Twitter 
Find Me On LinkedIn

P.S. Whenever you’re ready, here are a couple of ways for us to work together:

1. Level up your business with AI. We can help grow your business, save time, and get way more done with advanced AI automation and workflows. Get an Unfair Advantage Today

2. Want to promote your business to my community of ,000+ entrepreneurs, engineers, professionals, and AI enthusiasts? Advertise in AI For Work

________