Test & Evaluation
at the intersection of
People and AI.

Humane Intelligence builds the modular T&E stack that AI teams use to confidently ship GenAI models and agents. We operationalize the science of evaluation.

Trusted by enterprise & institutional partners

01 · Platform

A modular T&E stack for agentic AI.

Plug into our hosted evaluation infrastructure, or engage our forward-deployed engineers and consultant data scientists alongside your team. We're built for production-grade frontier models, agents, and the humans they impact.

Evaluation-as-a-Service

End-to-end studies run by Humane Intelligence PBC — protocol design, panel recruitment, red-teaming, statistical analysis, and audit-ready reporting. We own the rigor; you own the decisions.

  • Forward-deployed engineers embedded with your product team
  • Consultant data scientists for causal & subgroup analysis
  • Domain-recruited human panels with population-valid sampling
  • Audit-grade deliverables: scorecards, benchmark cards, signed reports

Platform-Only

Self-serve access to the same infrastructure our team uses. Spin up evaluations, manage harm taxonomies, run red-team campaigns, and ship versioned reports from a single repository.

  • Reusable protocol templates & harm taxonomies
  • Automated + human-in-the-loop red-teaming workflows
  • Versioned scorecards with machine-readable metadata
  • API + SDK for integration into existing CI/CD pipelines
02 · Approach

A statistically valid approach to AI-guided, human-centered test and evaluation.

Our orchestration environment enables a four-stage lifecycle that turns ambiguous AI capability claims into reproducible, audit-grade evidence. We host tools, taxonomies, notebooks and output to enable evaluations that are transparent and reproducible.

D

Design

Frame the question with rigor.

  • Outcome frameworks & harm taxonomies
  • Protocol templates & population definitions
  • Library of Experimental Designs
  • Success thresholds, decided up front
T

Test

Run the system at scale, against reality.

  • Benchmarks, automated & human red-teaming
  • Usability studies & simulated personas
  • A/B and mini-randomized controlled trials
  • Stress tests & real-world use logging
A

Analyze

Find the signal, surface the subgroups.

  • Causal & comparative analysis
  • Subgroup slices & failure-mode clustering
  • Mitigation tracking & longitudinal trends
  • Exportable, structured datasets
P

Publish

Make the evidence interoperable.

  • Versioned reports, scorecards & datasets
  • Benchmark cards & protocol cards
  • Reproducible workflow packages
  • Build your own library of custom benchmarks, golden datasets, and LLMs as a judge
03 · Research

Cutting-edge AI evaluation research.

Publications from our founder and collaborators are the methodological backbone of everything we build for clients.

04 · Team

Built by the people who built the field.

Dr. Rumman Chowdhury, Founder & CEO of Humane Intelligence PBC

Dr. Rumman Chowdhury

Founder & CEO

Dr. Rumman Chowdhury is the CEO and founder of Humane Intelligence PBC, building the modular evaluation stack that enterprises and governments use to deploy frontier AI responsibly.

She was the first U.S. Science Envoy for Artificial Intelligence, appointed by the Biden administration, and served on the inaugural U.S. Department of Homeland Security AI Safety and Security Board and the City of New York's AI Steering Committee. She's been named one of TIME's 100 Who Are Shaping AI, BBC's 100 Women, Bay Area's 40 under 40, and Forbes' Five Who Are Changing AI.

Previously, Rumman was Engineering Director of the META team at Twitter, founded Parity (acquired by Twitter), and built Accenture's Global Responsible AI practice. She co-founded Humane Intelligence Non-Profit.

Rumman holds a PhD from UC San Diego, an MS from Columbia, and a dual BS from MIT. More at rummanchowdhury.com.

Paolo Calvi, Staff Engineer at Humane Intelligence PBC

Paolo Calvi

Staff Engineer

Paolo Calvi is Staff Engineer at Humane Intelligence PBC, leading the backend and infrastructure that powers our evaluation platform — the systems that turn statistically valid T&E into production-grade software.

A senior backend and DevOps engineer with over a decade of experience shipping mission-critical systems, Paolo specializes in Python / Django, distributed architectures, and secure data infrastructure.

His toolkit spans Python, Django, PostgreSQL, Kubernetes, Redis, RabbitMQ, Elasticsearch, and AWS, with deep exposure to LLM engineering, prompt design, and NLP pipelines. Paolo is based in Aalen, Germany, and works across English, Italian, Portuguese, and German.

Ship AI with evidence,
not assumptions.

Whether you're a frontier model lab, an enterprise deploying agents at scale, or a regulator testing assurance frameworks, let's design the evaluations that test whether the system works for the people it impacts.

info@humane-intelligence.com