Skip to content
All cases

Designing how scientists work with AI in zebrafish experiments

A single zebrafish experiment can produce tens of thousands of microscope images. I designed the system that helps scientists analyse them with computer vision, review uncertain results and correct its output when it gets something wrong.

The product is now used commercially in six laboratories. In a typical 96-well experiment, automated analysis and the workflow around it reduced hands-on review from about eight hours to roughly 30 minutes.

Role
Senior Product Designer
Context
Sole designer, also leading product direction
Company
EmbryoNet AI Technologies
Product
EmbryoNet + EmbryoScan
Period
Aug 2023 – present

Laboratories use zebrafish embryos to study how drugs and other test substances (compounds) affect biological development. A single experiment can involve hundreds of embryos, several to each well of a 96-well plate, photographed repeatedly over many hours, producing tens of thousands of images that would otherwise need to be inspected by researchers.

EmbryoNet uses computer vision to analyse those images automatically. I joined the startup as its sole Senior Product Designer and designed the workflow around the model: setting up experiments, following changes over time, reviewing uncertain results, correcting errors and eventually running image capture on EmbryoNet’s own microscope.

Computer vision could analyse the images. The design challenge was turning those predictions into a scientific workflow researchers could trust and correct.

I had to learn the biology before I could design the system

Zebrafish experiments are time-sensitive. Once an experiment begins, researchers have a limited window to prepare embryos and start imaging before development moves on. So the software could not treat the experiment as a generic sequence of forms to fill in whenever convenient.

I spent time in the lab, then ran 35 interviews, contextual sessions and prototype tests; around 40 scientists and postdocs took part across these methods. That changed how I framed the product: a workflow connecting the physical plate, the microscope, the model and the scientist’s final decision.

The scientists understood the biology. My job was to understand which parts of their scientific reasoning the product needed to support.

Wet labEmbryoNetweb appInstrument +local processingsetupphysical plateSpawningCollect embryosSort and stageembryosPrepare96-well plateDefine plate mapChoose imagingprotocolAssigninstrumentCapture framesover timeLocal imageanalysisResultsMost resultssettleautomaticallyFlagged resultHuman reviewConfirmCorrect from firstwrong frame,reanalyseSign offexperimentStructured report/ integration

Each version let scientists ask a better question

V1: What happened?

The first version analysed an uploaded batch of microscope images and classified each embryo after processing finished.

It automated a lot of manual image review, but it could only answer a final-state question: what happened to this embryo?

View full size

V2: When did it happen?

Observing scientists work with the results revealed a limitation: the final classification was often not the most useful part of the experiment. Researchers wanted to know when a biological change first appeared, how quickly it progressed and whether higher doses made it happen earlier.

Once we started following the same embryo across time, I redesigned the product around that history rather than around individual images.

View full size

V3: Image capture became part of the system

Until then, laboratories produced the microscope images elsewhere and brought them into EmbryoNet for analysis.

The company then built EmbryoScan, its own automated microscope that images hundreds of embryos again and again over many hours. That extended my work from analysis software into the physical experiment itself: preparing a run, assigning a microscope, guiding scientists through setup at the bench and transferring the results back to the web application.

EmbryoScan’s optics: the camera under the plate stage and its light.

I used the plate scientists already worked with

Scientists were already organising every experiment around a physical 96-well plate, a tray of 96 small samples. I used that same structure as the main interaction model in the software.

Before EmbryoNet, researchers often recreated the plate in Excel, printed it, and marked wells by hand while preparing the experiment. Someone rebuilt the digital record afterwards, so a single transcription mistake could carry through to the results.

I designed the setup around the same spatial patterns scientists already used at the bench: rows, blocks, controls, repeated samples and dose series. Spreadsheet import stayed available, but the system previewed imported data against the plate before accepting it.

Selecting a row or block applies the same setup to multiple wells at once.View full size
Imported data is previewed against the 96-well plate before it is accepted.View full size

I redesigned analysis around time, not snapshots

The microscope captures the same embryo every few minutes. A final image can show what it looks like at the end, but not when a change started, what happened before it, or how quickly it progressed.

I reorganised the analysis around a timeline. Scientists could move through the image sequence while keeping measurements and the model’s classification in the same context. The product stopped treating images as separate predictions and started representing a biological process unfolding over time.

The product tracks developmental time in hours post-fertilisation (hpf).

The image sequence, measurements and model result stay together on one timeline.View full size

Then we needed to compare when the effect appeared at each dose

Once the product tracked time, we could answer a second question: did a higher dose make the same effect appear earlier?

I designed a dose × time view where colour shows the share of affected embryos at each time point. A boundary marks the first time at which at least half of the embryos at that dose were affected. Scientists could then move from the aggregate pattern back to the individual wells and image frames behind it.

View full size

From the pattern back to the evidence

Selecting a cell opens the wells and image frames behind the aggregate result.

View full size
View full size

I routed only uncertain results to human review

Every result still had a confidence score, but asking a scientist to scan all 96 wells meant automation had not removed the review work.

I added a lab-level review rule. The system flagged a result when confidence was low, when it disagreed with comparable wells, or when the system detected something unusual that needed a person to decide. In a typical run, only around 3–7% of results needed detailed review.

Scientists could still open every other result, without confirming each one. Nobody could sign off the experiment until someone had resolved every flagged case.

Before this change, scientists scanned every result. The new review view only surfaces cases that need a decision.

View full size
View full size

Corrections started at the first frame where the model diverged

A wrong final result usually started earlier: the model misread the embryo at some frame, and every later read built on that mistake. Overwriting the final label would fix the symptom but leave the time-series inconsistent.

I made correction a two-step flow. First, the scientist finds the earliest frame where the model is wrong. Then they change the result and preview exactly which part of that well will be reanalysed. The scope is visible before anything is committed.

1. Find the first incorrect frame

View full size

2. Change the result and review the scope

View full size

3. Review can continue while B5 is reanalysed

EmbryoNet reanalyses B5 in the background, so the scientist can keep reviewing other flagged results.

View full size

Labs controlled model improvement and data sharing separately

Corrections were useful in two different ways: a laboratory could use approved corrections to improve its own model, and it could choose to share eligible data with EmbryoNet to improve provider models. We made them two separate permissions.

Approved corrections went into a training set the lab owned. A designated reviewer checked them before the lab trained a new model version and validated it against previously reviewed experiments it had not trained on. Sharing approved data with EmbryoNet was a separate opt-in setting.

The system also kept a traceable history of review, corrections, model versions and sign-off decisions.

View full size

Lab model improvement and data sharing are separate settings.

View full size

The microscope needed a different interface from the web app

Scientists used the web application for dense analysis, comparison and model work. At the microscope they stood at the bench, often in gloves, with their attention on the plate and the hardware, not on software navigation.

Reusing the desktop interface would have been the wrong interaction model. I designed the touchscreen around large targets, minimal typing, one task at a time and very clear hardware state.

NoYesYesNo1 · Run ready in web appChoose instrument2 · Assign instrumentSend to ES-023 · Load platePlate loaded4 · Plate detectedP-0896 wellsBF-24-4ReloadContinueCorrectplate?5 · Focus & calibrationAuto focusConfirm6 · PreflightChamberCameraFocusStorageContinueAll checkspass?Resolve issue7 · Ready to run24 hevery 4 minStart run8 · Running06:12PauseStop runResults syncto web app
EmbryoScan ES-02 with its door open: the plate stage under the light, the camera below it.
The touchscreen uses large targets, minimal typing and explicit hardware states for work at the bench.
A prepared plate is assigned to an available instrument from the web app.View full size
View full size

We moved image processing next to the microscope

Continuous imaging produces far more raw video than a normal laboratory network can upload during an experiment. A cloud-first workflow would have made scientists wait for the data before analysis could even begin.

We moved computer-vision processing to local hardware beside the microscope. The local hardware analysed frames as the microscope captured them, and the web application received structured time-series measurements and short evidence clips for results that needed review. The full frames stayed on the local unit and were streamed on demand when a scientist opened a well or sent it for reanalysis.

Microscope
Captures raw frames
Raw frames stay in the lab
Local analysis
Processes the image stream beside the microscope
Structured results + selected evidence clips
Web application
  • Time-series measurements
  • Model results
  • Flagged cases
  • Review clips

I kept EmbryoNet focused on the experiment, not the lab’s entire software stack

As the product grew, there was pressure to add inventory, accounting, compliance records, barcode workflows and other laboratory administration.

Specialised systems in the labs we worked with already handled those jobs. Rebuilding them would have made the product much larger without improving the experiment workflow or the computer-vision analysis.

We kept EmbryoNet focused on experiment setup, imaging, analysis, review and correction. For the rest, we built software integrations with the systems laboratories already used, and generated a structured report package when an experiment was complete.

This also replaced the fragile manual CSV handoff that had caused errors earlier in the workflow.

Integrations used REST APIs and webhooks where the existing system supported them.

EmbryoNet
  • experiment setup
  • imaging
  • analysis
  • review
  • correction
API / webhook integrations
Existing lab software
  • inventory
  • records
  • compliance
  • other administration
Experiment complete
Structured report

What changed

The time saving did not come from interface design alone. Computer vision automated most of the image analysis; my work was designing the workflow around it: how scientists set up the experiment, inspect the evidence, decide where attention is needed, correct mistakes and sign off the result.

Hands-on review for one 96-well experiment
8 h → ~30 min
Commercially using the product
6 laboratories
Results typically requiring detailed manual review
3–7%

The workflow also made decisions traceable: the same system recorded reviews, corrections, model updates and experiment sign-off.

What I would explore next

Today, adding a new biological marker can require another specialised model, another dataset and another validation step.

I would explore whether a more general biological-vision model could answer new questions on the same time-series without training a separate model for every marker. For example: “Find when the tail starts to bend and plot how its curvature changes afterwards.”

The challenge would be gaining that flexibility without losing the validation and human control that make the current workflow trustworthy.

Exploratory concept, not part of the current product.View full size
Next caseMortgage RetentionAn AI engine flagged mortgage customers likely to refinance with another lender. I designed the product around it: signals, customer workflows and an assistant for bank advisors and managers.Read the case studyThe DataGems Portfolio Recapture dashboard on a laptop: 1,146 customers newly flagged after today’s rates, three offers with the customers who qualify, the portfolio by product and a map of customers by state.

Open to Senior Product Designer roles

Based in Porto, Portugal, with authorisation to work here. Get in touch about a Senior Product Designer role or to discuss my work in more detail.