Barranco Studio

Getting Started with Video, Voice, and Route Sharing in CarPlay (iOS 27)

In this tutorial, you’ll learn about the latest features introduced in CarPlay for iOS 27. We will break down complex engineering concepts—like Frameworks, Entitlements, and Route Sharing—into plain English so you can easily understand how to build or update apps for the car screen.


1. Welcome to CarPlay in iOS 27

CarPlay is Apple’s system that lets users interact with their iPhone apps safely while driving, using the car's built-in display. iOS 27 expands what CarPlay can do by introducing completely new app categories and expanding visual features.

New App Categories Supported

  • Voice-Based Conversational Apps: Apps that rely heavily on speaking and listening to handle tasks.
  • Video Browsing Apps: A major new update! Users can now browse and play video content directly on the car display when the vehicle is safely parked.

2. Bringing Video to the Car Screen

One of the biggest additions is the ability to browse and play video. However, because safety is the priority, there are specific rules for how this works.

Key Concepts Explained

  • AirPlay Video Streaming: This is the underlying technology Apple uses to send video from an iPhone to another screen. If your app already supports AirPlay, it can easily display video in CarPlay.
  • CarPlay Entitlements (Permissions): Think of an entitlement as a digital passport or permission slip granted by Apple. Without the correct entitlement, your app cannot use certain car features.
💡 Pro-Tip for Developers:
• If your app only has a Video Entitlement, it will only show up on the car's home screen if the car physically supports video.
• If your content is great for both watching and listening (like a sports broadcast or a video podcast), include both the Audio and Video Entitlements. This guarantees your app always shows up on the home screen. If the car starts moving, the system will automatically flip a switch to play audio-only, keeping the driver safe.

3. The CarPlay Framework & UI Updates

What is a Framework?

A Framework is a library of pre-built code, tools, and visual layouts (called Templates) provided by Apple. Instead of coding a custom button or designing a layout from scratch, you use Apple’s templates. This ensures that iOS automatically handles the heavy lifting, making your app look perfect regardless of screen resolution or physical control knobs.

iOS 27 introduces several new design upgrades to these templates:

Custom Image Layouts & Overlays

Lists can now show pictures in standard vertical (portrait) or wide (landscape) shapes. You can also add Thumbnails with Overlays to display extra information right on top of an image:

Overlay Type What It Displays
Status Badges Labels an item as "Live", "New", or "Unplayed".
Sports Overlays Displays live team matchups, logos, and real-time scores directly on the graphic.
Progress Bars Uses the app's metadata to render the exact elapsed time and remaining duration.

The Details Header

This layout places one main item prominently at the very top of a list (like a featured movie or the latest episode of a podcast) with a large picture, title, description text, and quick action buttons. Below is a structural mockup of how it maps onto the screen:

+--------------------------------------------------------+
|  [ LARGE THUMBNAIL ]  Featured Episode Title           |
|                       Description body text...         |
|                       [ PLAY ]  [ + PLAYLIST ]         |
+--------------------------------------------------------+
|  Item 2 (Related Video / Next Episode List row)         |
+--------------------------------------------------------+
|  Item 3 (Related Video / Bonus Content row)            |
+--------------------------------------------------------+

The MiniPlayer

A compact control bar that automatically appears on the screen to let users quickly play, pause, or skip tracks without leaving their current view. If you don't want it, you can turn it off in your code by setting allowsMiniPlayer to false, which moves a simple icon up to the top navigation bar instead.


4. Upgrading Voice Control

If your app uses voice commands, iOS 27 makes it much easier to manage conversations inside the car using the Voice Control Template.

  • Overlay Style: Instead of taking over the entire car screen, the voice assistant window can now float cleanly as an overlay on top of whatever the user is already doing (like looking at a map). Note: Remember to provide shorter text variants so the content comfortably fits this smaller space.
  • Action Buttons: You can add up to two buttons to the voice window. For example, if a user asks for a restaurant's location, the app can offer a "Navigate" button right in the voice prompt.
  • Audio Cues: To prevent the driver from staring at a frozen screen wondering if the app heard them, you should set up your audio settings (AVAudioSession) to play gentle status sounds—like a "waiting sound" while the app loads, or a "processing sound" while it thinks of a response.

5. Advanced Navigation Features

Navigation apps get two major upgrades in iOS 27: Panels and Route Sharing.

UI Panels

Instead of being forced into Apple's standard map flow, navigation apps can now create custom Panels. These slide-out cards let you cluster multiple items together (like route options, waypoints, and a "Go" button) while keeping the background map perfectly visible.

Route Sharing

This is a smart communication system where your phone's navigation app talks directly to the car's built-in computer systems. This is incredibly helpful for modern features like Driver Assistance (enabling automatic lane changes because the car knows where you need to turn) and Electric Vehicle (EV) Smart Routing:

[Navigation App] --- Sends Route Coordinates ---> [Electric Vehicle]
|
[Navigation App] <-- battery="" calculates="" charger="" pre="" range="" stop="" suggests="">
  1. You set a long-distance trip on your phone.
  2. Route Sharing sends those coordinates to the car.
  3. The electric car realizes it will run out of battery before the final destination.
  4. The car's computer finds a charging station along your route and sends a "suggested waypoint" back to your app.
  5. Your app automatically prompts the driver: "Would you like to add this charging stop?" Once accepted, the route updates seamlessly for both the car and the phone.

6. Testing with the CarPlay Simulator

You don't need to sit in a physical car with a laptop to test these features. Apple provides a tool called the CarPlay Simulator.

  • What it does: It mimics a car dashboard right on your Mac computer screen.
  • New in iOS 27: The simulator is now conveniently located inside Apple's Device Hub. You can easily toggle settings to pretend you are connected to a vehicle that supports video displays, check how different screen resolutions look, or use new diagnostic tools to test how your navigation app shares routes.

Next Steps for Developers

  1. Got a video app? Add the video entitlement and design a browsing layout using the new landscape thumbnails.
  2. Got a voice app? Adopt the Voice Control overlay template and add action buttons.
  3. Got a navigation app? Implement UI Panels and opt-in to Route Sharing to make your app play nice with electric vehicles.

Now you're ready to rev up your app for CarPlay! Turn your attention to your project, choose one feature to start with, and try implementing it in the simulator.

Libera el poder de la Inteligencia Artificial en tu empresa

Desde optimizar procesos hasta predecir tendencias, Machine Learning ofrece una amplia posibilidad para impulsar el crecimiento y la eficiencia empresarial. Esta tecnología revolucionaria puede transformar los negocios, proporcionando insights valiosos, automatizando tareas repetitivas y mejorando la toma de decisiones. Un mundo de oportunidades para las empresas.

Actualidad

Publicaciones recientes sobre Machine Learning y Mobile App development.

Projects