What Is Computer Vision: A Plain-English Definition
Computer vision is the technical discipline of getting machines to understand images and video in a meaningful way. The word 'understand' is doing significant work in that sentence. Early computer vision systems could detect edges or match templates. Modern deep learning systems can identify that a photo contains a specific species of bird perched on a branch in a garden, read the handwritten text on a sign in the background, estimate the time of day from the lighting, and detect whether the garden belongs to a residential or commercial property. The capabilities that matter most for product builders fall into several categories. Image classification assigns a category label to an entire image. Object detection identifies multiple objects within an image and draws bounding boxes around each. Image segmentation goes further, classifying each pixel as belonging to a specific object or region. Optical character recognition (OCR) reads text from images. Pose estimation tracks body positions and movements. Anomaly detection identifies when something in an image differs from an expected pattern. These capabilities are delivered through deep learning models, predominantly convolutional neural networks and, increasingly, vision transformers. These models are trained on labelled datasets where humans have annotated what is present in each image, then generalise to unseen images. The most significant recent development for product teams is the emergence of large multimodal models that combine language and vision. GPT-4o, Claude 3.5 Sonnet, and Gemini 1.5 Pro can all accept images as part of a prompt and reason about what they contain. This means a significant range of computer vision tasks that previously required specialised models can now be handled by the same LLM you use for text processing, through a single API.
How Computer Vision Works
Modern computer vision models work by learning hierarchical visual representations from labelled training data. In a convolutional neural network, early layers learn to detect simple features like edges and colour gradients. Deeper layers combine these into higher-level patterns like textures, shapes, and object parts. The final layers use these representations to produce a classification, detection, or other output. Vision transformers, which adapt the transformer architecture from language models to visual data, divide images into patches and apply attention mechanisms across them, learning which parts of an image are relevant to each other. Models like CLIP from OpenAI learn joint representations of images and text, enabling retrieval of images using natural language queries. For product teams, the most common implementation path is to use a pre-trained foundation model via API rather than training from scratch. This is appropriate for most standard vision tasks. You send an image to an API endpoint, and the model returns a structured response: a list of detected objects, a classification label, extracted text, or a natural language description of the scene. Consider a concrete example from a UK insurtech startup. They want to automate initial damage assessment for motor insurance claims. Previously, a claims handler viewed each photo manually. Now, when a customer uploads photos of their damaged vehicle, the computer vision pipeline runs automatically. An object detection model identifies the vehicle make and model from the registration plate using OCR. A damage detection model, fine-tuned on examples of vehicle damage categories, classifies the type of damage visible in each image: dent, scratch, cracked glass, structural damage. An LLM with vision capability generates a natural language summary of the damage assessment. The claims handler sees the assessment alongside the photos, reviews it in seconds rather than minutes, and either approves it or flags it for manual inspection. The automated assessment handles 80% of straightforward claims without modification.
Why Computer Vision Matters for AI Product Development
Computer vision matters for product development because it turns images and video from passive media into structured, queryable data. Once visual content can be reliably interpreted by a machine, entire categories of manual inspection, review, and classification work become automatable. For founders, the key question is whether your product has a visual data source that currently requires human attention to extract value from. If the answer is yes, computer vision is worth exploring as a core product capability. The range of sectors where visual AI creates significant value is broad: retail, manufacturing quality control, medical imaging, agriculture, construction site monitoring, insurance claims, property inspection, and document processing all involve large volumes of visual data that humans currently process manually. Computer vision also enables product experiences that are qualitatively different from text-based AI. Search by image, visual product recommendations, AR features, and real-time video analysis create user interactions that cannot be replicated through text interfaces. Compliance implications for UK products are significant and sector-specific. Products that process images of people are processing biometric data under UK GDPR Article 9, which is special category data requiring explicit consent or another Schedule 1 condition under the Data Protection Act 2018. Products that process CCTV footage or surveillance video in public spaces may be subject to additional ICO guidance on surveillance camera use. Products used in employment contexts to monitor workers using vision AI face particularly strict scrutiny under both UK GDPR and employment law. These implications must be assessed before building, not after.
Common Use Cases in Production AI Products
Document processing and OCR is one of the highest-volume commercial applications of computer vision. Invoice processing, identity document verification, form digitisation, and receipt scanning all use computer vision to extract structured data from images. UK fintech companies use computer vision to verify identity documents for Know Your Customer compliance, checking the document type, extracting the holder's details, and cross-referencing against expected formats. Quality control and defect detection in manufacturing uses computer vision to inspect products on production lines at speeds and consistency levels that human inspectors cannot match. A specialist food manufacturer might run images of packaged products through a defect detection model to catch labelling errors, damaged packaging, or contamination before goods leave the facility. Property and infrastructure inspection uses aerial and ground-level imagery to assess building condition, detect structural issues, and monitor construction progress. UK proptech startups use satellite imagery and drone photography analysed with computer vision to produce automated property condition reports. Medical imaging analysis is an established and high-stakes application. AI models can assist radiologists by detecting potential anomalies in X-rays, MRI scans, and pathology slides. In the UK, these products must comply with MHRA guidance on AI as a medical device, which requires clinical evidence of safety and efficacy before deployment in clinical settings. Retail and e-commerce visual search allows users to search by uploading an image rather than typing a query. Visual product recommendations, outfit completion, and similar-item suggestions are all powered by computer vision combined with embedding similarity search.
Related Concepts
Generative AI has a direct intersection with computer vision through image generation models like DALL-E 3, Midjourney, and Stable Diffusion. These systems use diffusion models to generate novel images from text descriptions. For product teams, generative vision AI opens possibilities for automated content creation, product visualisation, and creative tooling. Understanding the distinction between discriminative vision models that classify or detect, and generative models that create, is important for scoping what is feasible. Foundation models have become the dominant paradigm in computer vision. Large multimodal foundation models like GPT-4o and Gemini 1.5 Pro provide a general-purpose vision capability that can handle a broad range of tasks without task-specific training. Specialised vision models fine-tuned on domain-specific data remain superior for specific high-precision tasks, but the general-purpose foundation model covers the majority of product use cases with minimal setup. Inference cost and latency are particularly relevant for computer vision products that process large volumes of images or operate in real time. Processing 10,000 images per day through a cloud vision API has meaningful cost implications that must be factored into product economics from the start. For high-volume applications, on-device inference using optimised models deployed to edge hardware can reduce cost and latency significantly. Embedding models for vision, such as CLIP, allow images to be represented as vectors in a high-dimensional space. This enables semantic image search, where a natural language query returns visually relevant images, and visual recommendation, where similar products are found based on visual similarity rather than metadata tags. These capabilities combine computer vision with the vector database infrastructure used for text search. Natural language processing connects to computer vision through multimodal models that process both text and images. Vision-language models can answer questions about images, generate descriptions, and follow natural language instructions for visual tasks. This convergence means product teams building AI features rarely need to treat vision and language as separate capabilities.