Difference between revisions of "Mac OS X Porting - Native Audio and Video"

From Apache OpenOffice Wiki
Jump to: navigation, search
(Status)
(restoring content - vandalism)
 
(27 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
===Contributors===
 
===Contributors===
* Mox Soini: [[User:Mox|Mox]]
+
 
 
* Eric Bachard  (ericb at openoffice dot org )
 
* Eric Bachard  (ericb at openoffice dot org )
 +
* Mox Soini: [[User:Mox|Mox]]
  
 
=== Introduction===
 
=== Introduction===
 +
 +
'''Kai's Mail'''
 +
Work started discussing with Kai Ahrens (author of avmedia).
 +
As adviced by Kai we will reuse Windows implementation (copied/pasted from Kai's mail):
  
As part of native OpenOffice.org for Mac OS X, a Quicktime backend for avmedia module will be created, to support native audio and video on Mac OS X. Although this implementation concentrates on Mac OS X, it should be possible to make Quicktime backend work on Windows-platform too.
+
<blockquote>
 +
"... Beside the 'common' avmedia part, that is the same on all platforms and used from
 +
the high level application side, there are several backend (actually
 +
two, one for Windows and one for JMF backends) implementations already
 +
realized or to be realized like a Xine, GStreamer etc. backend..."
 +
<p>
 +
"...What you did so far, is absolutely the right way. Taking the existing
 +
Windows implementation and fill it with the appropriate Quicktime or
 +
whatever pieces. After finishing your new backend you should adjust
 +
the code in MediaWindowBaseImpl::createPlayer
 +
(avmedia/source/viewer/mediawindowbase_impl.cxx) accordingly to get your
 +
new component initialized instead of the existing ones.
 +
</p><p>
 +
Having a 'status' struct is already realized within
 +
mediawindowbase_impl.cxx and the corresponding methods
 +
MediaWindowBaseImpl::updateMediaItem and
 +
MediaWindowBaseImpl::executeMediaItem , I think, but maybe
 +
I didn't get you right here.
 +
</p><p>
 +
Please feel free to ask if you have any detailed questions.
 +
</p><p>
 +
With best regards,
 +
Kai"</p>
 +
</blockquote>
  
This approach was agreed with the author of avmedia module (Kai Ahrens, [[Native_Sound_Implementation_on_Mac_OS_X#Kai's_Mail|Kai's Mail]]).
+
 
 +
Recently, Radek Doulik and Cedric Bosdonnat did a conference at OOoCon, about GStreamer work on Linux
 +
 
 +
Use Radek Doulik and Cedric Bosdonnat gstreamer work: [http://marketing.openoffice.org/ooocon2006/schedule/wednesday.html OOoCon 2006 presentation], [http://eric.bachard.free.fr/mac/OOoCon2006/GStreamer-in-OpenOffice.org.odp slides (ODP)]
 +
 
 +
 
 +
 
 +
As part of native OpenOffice.org for Mac OS X, a Quicktime backend for avmedia module will be created, to support native audio and video on Mac OS X. Although this implementation concentrates on Mac OS X, it should be possible to make Quicktime backend work on Windows-platform too.
  
 
===Tasks===
 
===Tasks===
Line 13: Line 48:
 
OOo scope: avmedia module
 
OOo scope: avmedia module
  
Initial structure for the quicktime backend has been put up to [http://www.openoffice.org/issues/show_bug.cgi?id=69665 issue 69665]. It is based on the stub of Xine -backend, OOo milestone m184.
+
'''PRECONDITION:''' avmedia work depends on '''platform-independent UNO VCL API'''. This API is as of Feb 2007 not fully implemented in Mac OS X AQUA implementation of VCL. Until this API is completed, it is not possible to have working implementation of Quicktime avmedia module.
  
EricB made also some [http://eric.bachard.free.fr/mac/aquavcl/patches/player_aqua/avmedia/source/ initial modifications], but they use different naming conventions.
 
  
Implementation starting point:
+
The main issue used for this  task will be [http://www.openoffice.org/issues/show_bug.cgi?id=66170 #i66170#]. Everything concerning this task will be commited using this issue number.
* Look at Win and Java backends in avmedia module and
+
* Go through [http://developer.apple.com/documentation/QuickTime/APIREF/ Quicktime API reference], especially [http://developer.apple.com/documentation/QuickTime/APIREF/MovieFunctions.htm the Movie functions]
+
* Complete list of [http://developer.apple.com/documentation/QuickTime/APIREF/GettingandPlayingMovies.htm useful Quicktime functions]
+
  
Use Radek Doulik and Cedric Bosdonnat gstreamer work: [http://marketing.openoffice.org/ooocon2006/schedule/wednesday.html OOoCon 2006 presentation], [http://eric.bachard.free.fr/mac/OOoCon2006/GStreamer-in-OpenOffice.org.odp slides (ODP)]
+
All contributions are welcome, and all people interested for this task are invited to contribute.
  
 +
===Rules for contributions===
  
'''Related issues''':  
+
1) expected work
 +
 
 +
Code only is not sufficient: to improve our efficiency and to make this code maintainable, we must document it, and we have to do that in the same time we write it.
 +
 
 +
e.g.  UML Diagrams, Design patterns used. More generally, anything about Design is very welcome.
 +
 
 +
 
 +
2) About code
 +
 
 +
The conditions to be respected are : accepted JCA, and provide code respecting LGPL license used for OpenOffice.org.
 +
 
 +
 
 +
3) Implementation starting point:
 +
* Look at Win and Java backends in avmedia module and
 +
* Go through [http://developer.apple.com/documentation/QuickTime/APIREF/ Quicktime API reference], especially [http://developer.apple.com/documentation/QuickTime/APIREF/MovieFunctions.htm the Movie functions], [http://developer.apple.com/documentation/QuickTime/Reference/QTRef_MovieManager/Reference/reference.html Movie Reference]
 +
* Complete list of [http://developer.apple.com/documentation/QuickTime/APIREF/GettingandPlayingMovies.htm useful Quicktime functions]
 +
 
 +
4) '''Known issues''':  
 
Quicktime will not be able to play all windows .avi and .wma files, because it does not support them. We may need xine or some other player backend to see some of the OOo documents created on Windows/Linux OOo.
 
Quicktime will not be able to play all windows .avi and .wma files, because it does not support them. We may need xine or some other player backend to see some of the OOo documents created on Windows/Linux OOo.
  
Line 33: Line 82:
  
 
===Status===
 
===Status===
 +
 +
EricB started the work and proposed patches : [http://eric.bachard.free.fr/mac/aquavcl/patches/player_aqua/avmedia/source/ Aqua player implementation].
 +
 +
Mox proposed an initial structure for the quicktime backend has been put up to [http://www.openoffice.org/issues/show_bug.cgi?id=69665 issue 69665]. It is based on the stub of Xine -backend, OOo milestone m184.
 +
 +
'''[FIXME]''' : document this code
 +
  
 
* create manager ( using UNO services)  [ done ]
 
* create manager ( using UNO services)  [ done ]
 
** create uno layer [ done ]
 
** create uno layer [ done ]
** implement correct service name / implementation name using UNO  [ work in progress ]
+
** implement correct service name / implementation name using UNO  [ done ]
 
** create player (using QuickTime API)  [ work in progress ]
 
** create player (using QuickTime API)  [ work in progress ]
 
    
 
    
Missing (to be adapted for QuickTime) :
+
* Missing (to be adapted for QuickTime) :
 
+
 
using avmedia::quicktime::  
 
using avmedia::quicktime::  
  
Line 70: Line 125:
  
  
- all headers are defined [  Done (using existing Xine/Win implementation) ]
+
* all headers are defined [  Done (using existing Xine/Win implementation) ]
- usefull functions are identifed in Apple's API
+
* usefull functions are identifed in Apple's API
  
Found in System/Library/Framework/QuickTime.framework/Headers/Movies.h :
+
Found in /System/Library/Framework/QuickTime.framework/Headers/Movies.h :
  
 
  '''DisposeMovie()'''
 
  '''DisposeMovie()'''
Line 94: Line 149:
 
  [FIXME] not complete
 
  [FIXME] not complete
  
+
 
[To be continued]
+
  
 
Other work in progress :
 
Other work in progress :
- discuss with ka about new implementation and fix dark points
+
* discuss with ka about new implementation and fix dark points
- new implementation of  -already defined- methods used in the player
+
* new implementation of  -already defined- methods used in the player
 
+
* Todo : find infos about framegrabber.cxx ?
Todo : find infos about framegrabber.cxx ?
+
  
 
===Component Context===
 
===Component Context===
  
[FIXME]
+
[FIXME] use Radek and Cedric description, very interesting
  
 
===Component Design===
 
===Component Design===
  
[FIXME]
+
[FIXME] use Radek and Cedric description, very interesting
  
===Kai's Mail===
 
Work started discussing with Kai Ahrens (author of avmedia).
 
As adviced by Kai we will reuse Windows implementation (copied/pasted from Kai's mail):
 
 
<blockquote>
 
"... Beside the 'common' avmedia part, that is the same on all platforms and used from
 
the high level application side, there are several backend (actually
 
two, one for Windows and one for JMF backends) implementations already
 
realized or to be realized like a Xine, GStreamer etc. backend..."
 
<p>
 
"...What you did so far, is absolutely the right way. Taking the existing
 
Windows implementation and fill it with the appropriate Quicktime or
 
whatever pieces. After finishing your new backend you should adjust
 
the code in MediaWindowBaseImpl::createPlayer
 
(avmedia/source/viewer/mediawindowbase_impl.cxx) accordingly to get your
 
new component initialized instead of the existing ones.
 
</p><p>
 
Having a 'status' struct is already realized within
 
mediawindowbase_impl.cxx and the corresponding methods
 
MediaWindowBaseImpl::updateMediaItem and
 
MediaWindowBaseImpl::executeMediaItem , I think, but maybe
 
I didn't get you right here.
 
</p><p>
 
Please feel free to ask if you have any detailed questions.
 
</p><p>
 
With best regards,
 
Kai"</p>
 
</blockquote>
 
  
  

Latest revision as of 15:23, 30 January 2011

Contributors

  • Eric Bachard (ericb at openoffice dot org )
  • Mox Soini: Mox

Introduction

Kai's Mail Work started discussing with Kai Ahrens (author of avmedia). As adviced by Kai we will reuse Windows implementation (copied/pasted from Kai's mail):

"... Beside the 'common' avmedia part, that is the same on all platforms and used from the high level application side, there are several backend (actually two, one for Windows and one for JMF backends) implementations already realized or to be realized like a Xine, GStreamer etc. backend..."

"...What you did so far, is absolutely the right way. Taking the existing Windows implementation and fill it with the appropriate Quicktime or whatever pieces. After finishing your new backend you should adjust the code in MediaWindowBaseImpl::createPlayer (avmedia/source/viewer/mediawindowbase_impl.cxx) accordingly to get your new component initialized instead of the existing ones.

Having a 'status' struct is already realized within mediawindowbase_impl.cxx and the corresponding methods MediaWindowBaseImpl::updateMediaItem and MediaWindowBaseImpl::executeMediaItem , I think, but maybe I didn't get you right here.

Please feel free to ask if you have any detailed questions.

With best regards,

Kai"


Recently, Radek Doulik and Cedric Bosdonnat did a conference at OOoCon, about GStreamer work on Linux

Use Radek Doulik and Cedric Bosdonnat gstreamer work: OOoCon 2006 presentation, slides (ODP)


As part of native OpenOffice.org for Mac OS X, a Quicktime backend for avmedia module will be created, to support native audio and video on Mac OS X. Although this implementation concentrates on Mac OS X, it should be possible to make Quicktime backend work on Windows-platform too.

Tasks

OOo scope: avmedia module

PRECONDITION: avmedia work depends on platform-independent UNO VCL API. This API is as of Feb 2007 not fully implemented in Mac OS X AQUA implementation of VCL. Until this API is completed, it is not possible to have working implementation of Quicktime avmedia module.


The main issue used for this task will be #i66170#. Everything concerning this task will be commited using this issue number.

All contributions are welcome, and all people interested for this task are invited to contribute.

Rules for contributions

1) expected work

Code only is not sufficient: to improve our efficiency and to make this code maintainable, we must document it, and we have to do that in the same time we write it.

e.g. UML Diagrams, Design patterns used. More generally, anything about Design is very welcome.


2) About code

The conditions to be respected are : accepted JCA, and provide code respecting LGPL license used for OpenOffice.org.


3) Implementation starting point:

4) Known issues: Quicktime will not be able to play all windows .avi and .wma files, because it does not support them. We may need xine or some other player backend to see some of the OOo documents created on Windows/Linux OOo.

For other backends, make sure that we don't build backends that we don't need (i.e. if defined QUARTZ/MACOSX)

affected files (at least): avmedia/source/xine/makefile.mk

Status

EricB started the work and proposed patches : Aqua player implementation.

Mox proposed an initial structure for the quicktime backend has been put up to issue 69665. It is based on the stub of Xine -backend, OOo milestone m184.

[FIXME] : document this code


  • create manager ( using UNO services) [ done ]
    • create uno layer [ done ]
    • implement correct service name / implementation name using UNO [ done ]
    • create player (using QuickTime API) [ work in progress ]
  • Missing (to be adapted for QuickTime) :

using avmedia::quicktime::

Player::Player()    // Ctor
Player::~PLayer() // Dtor
bool Player::create()
const Player::getVideoWindow()
void Player::setNotifyWnd()
void Player::setDDrawParams()  // maybe not needed
long Player::processEvent()
void Player::start()
void Player::stop()
sal_Bool Player::isPlaying()
double Player::getDuration()
void Player::setMediaTime()
double Player::getMediaTime()
void Player::setStopTime()
double Player::getStopTime()
void Player::setRate()
void Player::getRate()
void Player::setPlaybackLoop()
void Player::isPlaybackLoop()
void Player::setMute()
sal_Bool Player::isMute()
void Player::setVolumeDB()
sal_Int16 Player::getVolumeDB()

[FIXME] Other methods to be implemented ?


  • all headers are defined [ Done (using existing Xine/Win implementation) ]
  • usefull functions are identifed in Apple's API

Found in /System/Library/Framework/QuickTime.framework/Headers/Movies.h :

DisposeMovie()
Frees any memory being used by a movie, including the memory used by the movie's tracks and media structures.
EnterMovies()
Initializes the Movie Toolbox and creates a private storage area for your application.
GetMovieDuration()
Returns the duration of a movie.
GetMovieRate()
Returns a movie's playback rate.
GetMovieTime
Returns a movie's current time both as a time value and in a time structure. 
GetMovieVolume
Returns a movie's current volume setting.
IsMovieDone
Determines if a particular movie has completely finished playing.
SetMovieGWorld
Establishes a movie's display coordinate system by setting the graphics world for displaying the movie.

[FIXME] not complete


Other work in progress :

  • discuss with ka about new implementation and fix dark points
  • new implementation of -already defined- methods used in the player
  • Todo : find infos about framegrabber.cxx ?

Component Context

[FIXME] use Radek and Cedric description, very interesting

Component Design

[FIXME] use Radek and Cedric description, very interesting

Personal tools