MediaArchitecture

Differences between revisions 4 and 5
Revision 4 as of 2013-04-03 15:37:52
Size: 1253
Editor: lool
Comment:
Revision 5 as of 2013-04-03 15:59:56
Size: 1960
Editor: lool
Comment:
Deletions are marked like this. Additions are marked like this.
Line 15: Line 15:
 * Media capture / encoding  * Media capture / encoding and transcoding
Line 19: Line 19:
 * !UPnP -- might be provided by apps though
Line 31: Line 32:
On Android, media decoding is provided by a separate Media Service process which provides audio and video decoding  On Android, media decoding is provided by a separate Media Service process which provides audio and video decoding.
Line 33: Line 34:
== == == Media indexing ==

== Media control ==

== Power management ==


== DRM / security ==

== Codecs ==

== Import / export / share ==

Syncing over USB and Bluetooth
U1?

== Dock / external screen ==

Applications don’t control which output they are on, but get notified of the new display properties. This will also affect media playback.

== Audio input + output selection / plug detection ==

Not covered by this spec, but see Ricardo Salveti’s spec on audio input + output selection and plug detection.

== API ==



== Architecture ==

(insert diagrams here)
{{attachment:some.png|some description|width=60%}}

Blueprint: https://blueprints.launchpad.net/ubuntu/+spec/client-1303-hw-video-decode-rendering-support

Goals

  • audio and video playback
  • hardware accelerated
  • Ubuntu Touch for now; Ubuntu Desktop in the future
  • leverage Android BSPs of supported Ubuntu Touch devices
  • DRM support

Out of scope

  • Media capture / encoding and transcoding
  • Webcam
  • Currently not directly targeting Ubuntu Desktop
  • Currently not targeting WiFi Direct

  • !UPnP -- might be provided by apps though

Requirements

  • Need to have a DRM solution for commercial products (OEM and media content industry requirement)
    • DRM solution might impose extra requirements on e.g. access to buffers, multiple processes, security/confinement etc.
  • Support at least the codecs supported in the Android phones we're targeting as supported Ubuntu Touch devices
  • Concurrent playback of multiple streams (at least audio mixing)
  • Bluetooth audio output (e.g. headset)
  • Media indexing?

Android bits

On Android, media decoding is provided by a separate Media Service process which provides audio and video decoding.

Media indexing

Media control

Power management

DRM / security

Codecs

Import / export / share

Syncing over USB and Bluetooth U1?

Dock / external screen

Applications don’t control which output they are on, but get notified of the new display properties. This will also affect media playback.

Audio input + output selection / plug detection

Not covered by this spec, but see Ricardo Salveti’s spec on audio input + output selection and plug detection.

API

Architecture

(insert diagrams here)

Touch/MediaArchitecture (last edited 2016-05-06 15:04:24 by localhost)