Skip to content
Signal65

Product Testing & Validation

Hands-on testing, benchmarking, and claims validation from Signal65 engineers, so buyers hear your claims from an independent lab.

Buyers discount vendor claims

Every launch says faster, cheaper, and easier to run, and buyers have learned to tune it out. Results from an independent lab, with the method behind them, give your claims weight with the people who sign off.

What Signal65 does

  • Testing and analysis

    Hands-on testing by data center and client device engineers, in our labs or remotely in yours. That includes pre-production hardware and systems that are hard to ship.

  • Claims validation

    Benchmarks, competitive comparisons, and experience and usability testing, written up as lab reports and white papers. The Signal65 Certified & Verified program puts Signal65's name behind the results.

  • Technical marketing

    Messaging, technical documentation, white papers, sales enablement, infographics, and reviewer guidance, built from the test data.

What we test

  • Data center and IT infrastructure

    • Servers, storage, networking, and components
    • VMware, Kubernetes, and bare-metal environments
    • On-premises and public cloud deployments
    • SQL and NoSQL databases and enterprise workloads
  • Client and edge devices

    • Laptops and desktops
    • Commercial workstations, upgrade cycles, and manageability
    • AI PCs, gaming, and creator workloads
    • Segment definitions and virtual review programs
  • AI and the future of compute

    • Model training and inference
    • RAG pipelines and computer vision
    • Agentic AI workloads
    • Proof-of-concept builds and custom workloads

Our labs

  • Lab facilities

    Dedicated lab space in Boulder, Chicago, and Cincinnati, where we set up, configure, and run data center infrastructure at scale for comparative testing. When hardware is scarce or pre-production, we test remotely in your lab.

  • AI Lab in Colorado

    • 3MW+ capacity, air-cooled today, with liquid cooling planned
    • LLM training and inference, RAG pipelines, and computer vision
    • 400/800G fabrics, high-memory nodes, and scalable NVMe and object storage
    • Secure remote access and reproducible testbeds

Signal65 PINNACLE

A benchmark for enterprise agentic AI that measures correct work. Agents run multi-step business jobs on generated enterprise data, and every result is graded in code against an answer key, with no model judging the output.

  • Model Score

    Grades models on whether agentic business jobs come out right, on organized data and on data as it accumulates.

  • Capacity

    Measures how many agents a GPU platform sustains while each one stays above a usable speed.

  • Solutions

    Combines the two into the cost of a correct task, on a hosted API or a self-hosted node.

See PINNACLE results (opens in a new tab)

How it works

  1. 01

    Scope

    Agree on the claim to test, what to compare it against, and the buyer it has to convince.

  2. 02

    Test

    Our engineers run the testing in our labs, or remotely in yours.

  3. 03

    Verify

    Engineers and analysts review the results, and the method is documented so a skeptical buyer can check it.

  4. 04

    Share

    Get a lab report, white paper, executive summary, or infographic. Add Futurum Media to put it in front of buyers.

    Futurum Media

Proof only counts if it's independent

  • You can check the method

    Every report documents how we tested, what we compared, and why.

  • Named experts

    The engineers and analysts behind each report are named on it.

Featured from Futurum Research

ROI Spectrum: proof for the business side

Signal65 shows technical buyers that your product performs. ROI Spectrum shows the CEO, CFO, and finance team that it pays, with business-value models built on customer interviews and Futurum data.

  • Economic impact models

    Total economic impact and payback models for your product.

  • Value drivers

    Confirmed by the customers who use your product.

  • Value calculators

    Calculators your sellers can use in every deal.

  • CFO-ready assets

    Business case material built for the finance sign-off.

The team

  • Ryan Shrout

    Ryan Shrout

    President and GM

    Ran a top technical review outlet for 18 years, then led competitive performance analysis at Intel.

    Profile
  • Russ Fellows

    Russ Fellows

    VP, Labs

    More than 30 years across engineering, IT management, marketing strategy, and industry analysis.

    Profile
  • Brian Martin

    Brian Martin

    AI and Data Center Lead

    Three decades in distributed system design and performance, in companies large and small.

    Profile
  • Ken Addison

    Client Performance Director

    A decade of client device reviews, then performance and competitive analysis at Intel. Leads client device testing.

Recent research

  • Signal65 · Nov 3, 2026

    Correct work, measured

    The first PINNACLE results: 44 model configurations, run on the same enterprise jobs and graded in code.

    Read on Signal65 (opens in a new tab)
  • Signal65 · Brian Martin · Oct 20, 2026

    Fine-tuning small language models for the edge

    What testing shows about fine-tuning compact models and choosing the smallest one that reliably does the job.

    Read on Signal65 (opens in a new tab)
  • Signal65 · Mitch Lewis · Sep 15, 2026

    Trusted answers at enterprise scale

    Which models retrieve information, and recognize when it's missing, as enterprise document loads grow.

    Read on Signal65 (opens in a new tab)
See all Signal65 research (opens in a new tab)

Let's talk

How can we help?

Become a client

What kind of support are you looking for?
Technology markets your company aligns to

By checking the boxes below, you agree to receive communications from The Futurum Group. You can unsubscribe anytime.

To process your request, we need your permission to store and process your personal data. Please check the box below to confirm your consent:

Privacy policy

The Weekly

Get the week's market signals in one email

What changed in tech this week and why it matters, in a five-minute read.