Hardy

Differences between revisions 21 and 42 (spanning 21 versions)
Revision 21 as of 2007-11-30 17:01:35
Size: 8507
Editor: adsl203-157-083
Comment:
Revision 42 as of 2008-11-07 15:34:02
Size: 6199
Editor: d83-183-69-42
Comment: link to bug report
Deletions are marked like this. Additions are marked like this.
Line 6: Line 6:
 * '''Created''': [[Date(2007-10-17T14:57:00Z)]] by AlessioIgorBogani
 * '''Contributors''': [wiki:PeterLJones PeterLJones], [wiki:DeraldWoods DeraldWoods], [wiki:miguel Miguel]
 * '''Source Package''':
 * '''Binaries Packages''':
 * '''Created''': <<Date(2007-10-17T14:57:00Z)>> by AlessioIgorBogani
 * '''Contributors''': [[PeterLJones|PeterLJones]], [[DeraldWoods|DeraldWoods]], [[miguel|Miguel]]
 * '''Source Package''': linux
 * '''Binaries Packages''': linux-image-2.6.24-X-rt, linux-headers-2.6.24-X-rt, linux-restricted-modules-2.6.24-X-rt, linux-ubuntu-modules-2.6.24-X-rt
Line 14: Line 14:

##== Release Note ==
##
##This section should include a paragraph describing the end-user impact of this change. It is meant to be included
##in the release notes of the first release in which it is implemented. (Not all of these will actually be included
##in the release notes, at the release manager's discretion; but writing them is a useful exercise.)
##
##It is mandatory.
Line 29: Line 21:
'''1. Deterministic (Hard-Realtime)''' [Industrial Control, Robotics, Automation, DAQ, etc.][[BR]] '''1. Deterministic (Hard-Realtime)''' [Industrial Control, Robotics, Automation, DAQ, etc.]<<BR>>
Line 31: Line 23:
    * Alex is developing an application ([http://en.wikipedia.org/wiki/SCADA SCADA] type) for a customer and he would be very happy to use Linux and Ubuntu for the deployment.     * Alex is developing an application ([[http://en.wikipedia.org/wiki/SCADA|SCADA]] type) for a customer and he would be very happy to use Linux and Ubuntu for the deployment.
Line 35: Line 27:
'''2. Non-Deterministic (Low-Latency)''' [Data Sampling, Analysis Tools, Realtime Monitoring, etc.][[BR]] '''2. Non-Deterministic (Low-Latency)''' [Data Sampling, Analysis Tools, Realtime Monitoring, etc.]<<BR>>
Line 37: Line 29:
    * Beth is a user wanting application stability but with real-time performance capability for running Audio and MIDI applications (such as [http://jackaudio.org/ JACK] and its clients). This could include running a full [http://www.x.org X]/[http://www.gtk.org Gtk] UI stack with [http://www.winehq.com WINE] and/or [http://www.joebutton.co.uk/fst/ FST], with networking to allow for collaborative performances (e.g. [http://ninjam.com NINJAM]). Stability: must be reliable enough for live performance (system hangs look terribly unprofessional). Performance: no dropped MIDI messages (hanging notes suck...), no dropped audio frames (audio glitches suck...).

##Other use cases?
    * Beth is a user wanting application stability but with real-time performance capability for running Audio and MIDI applications (such as [[http://jackaudio.org/|JACK]] and its clients). This could include running a full [[http://www.x.org|X]]/[[http://www.gtk.org|Gtk]] UI stack with [[http://www.winehq.com|Wine]] and/or [[http://www.joebutton.co.uk/fst/|FST]], with networking to allow for collaborative performances (e.g. [[http://ninjam.com|NINJAM]]). Stability: must be reliable enough for live performance (system hangs look terribly unprofessional). Performance: no dropped MIDI messages (hanging notes suck...), no dropped audio frames (audio glitches suck...).
Line 45: Line 35:
### == Assumptions == == Implementation ==
Line 47: Line 37:
## * [wiki:KernelTeam/Hardy/KernelVersion Kernel Version]: 2.6.24?
## * [http://lwn.net/Articles/230501/ Scheduler] in stock kernel: CFS
We will use the new kernel build system created by the Ubuntu Kernel Team for production kernel: [[http://kernel.ubuntu.com/git?p=ubuntu/ubuntu-hardy.git;a=blob;hb=HEAD;f=debian/binary-custom.d/README|More nformation about it]].
Line 50: Line 39:
##== Design ==
##
##You can have subsections that better describe specific parts of the issue.
##Debug version and
Line 54: Line 41:
##== Implementation ==
##
##This section should describe a plan of action (the "how") to implement the changes discussed. Could include
##subsections like:
Rt-tests packages will be released through [[https://launchpad.net/~abogani|Alessio's]] [[https://help.launchpad.net/PPA|PPA]] archive.
Line 59: Line 43:
##=== UI Changes ===
##
##Should cover changes required to the UI, or specific UI that is required to implement this
We use [[KernelGitGuide|Git]] for handle kernel source code and [[http://savannah.nongnu.org/projects/quilt|Quilt]] for handle the preempt-rt one.
Line 63: Line 45:
##=== Code Changes ===
##
##Code changes should include an overview of what needs to change, and in some cases even the specific details.
Other utilities as like [[http://rt.wiki.kernel.org/index.php/Preemption_Test|Preemption test]] or [[http://devresources.linux-foundation.org/craiger/hackbench/|hackbench]] are postponed to hardy+1. It is the same for integration with PolicyKit (framework for secure privilege elevation integration) and for RT related documentation due to lack of interest.
Line 67: Line 47:
##=== Migration ===
##
##Include:
## * data migration, if any
## * redirects from old URLs to new ones, if any
## * how users will be pointed to the new way of doing things, if necessary.
== Outstanding Issues ==
Line 74: Line 49:
##== Test/Demo Plan == 1. High precision timers don't work on machine which have only PIT as souce clock [[http://www.mail-archive.com/linux-rt-users@vger.kernel.org/msg00375.html|more info]] <<BR>>
2. The realtime kernel could expose you to security issues (probably local only) <<BR>>
3. Restricted modules increase latencies (please buy only hardware which have a free driver!) <<BR>>
Line 76: Line 53:
##It's important that we are able to test new features, and demonstrate them to users. Use this section to describe a
##short plan that anybody can follow that demonstrates the feature is working. This can then be used during CD
##testing, and to show off after release.
##
##This need not be added or completed until the specification is nearing beta.
== Packages available ==
Packages available in Hardy archive: <<BR>>
linux-rt <<BR>>
linux-image-rt <<BR>>
linux-image-2.6.24-16-rt <<BR>>
linux-ubuntu-modules-2.6.24-16-rt <<BR>>
linux-headers-rt <<BR>>
linux-headers-2.6.24-16-rt <<BR>>
linux-restricted-modules-rt <<BR>>
linux-restricted-modules-2.6.24-16-rt <<BR>>
linux-backports-modules-rt <<BR>>
linux-backports-modules-hardy-rt <<BR>>
linux-backports-modules-2.6.24-16-rt <<BR>>
Line 82: Line 67:
### == Outstanding Issues ==
##
##This should highlight any issues that should be addressed in further specifications, and not problems with the
##specification itself; since any specification with problems cannot be approved.

## * How will -rt fare with the introduction of CFS, replacing O(1).
Packages available in [[https://launchpad.net/~abogani/+archive|Alessio's PPA]] archive: <<BR>>
rt-tests <<BR>>
Line 91: Line 72:
'''Q) Did you manage to include all the regular Ubuntu kernel patches in it? If not, is it possible to know what was left out?''' [[BR]] '''Q) Did you manage to include all the regular Ubuntu kernel patches in it? If not, is it possible to know what was left out?''' <<BR>>
Line 94: Line 75:
'''Q) Where can I find documentation?''' [[BR]] '''Q) Where can I find documentation?''' <<BR>>
Line 97: Line 78:
'''Q) What are the differences from vanilla Ingo Molnar's patch?''' [[BR]]
A) A simple adaptation to the BenC's kernel git tree isn't the only difference: We work on Ubuntu specific code or drivers (aka linux-ubuntu-modules/linux-restricted-modules) and also remove all code which isn't strictly related to real-time pre-emption support (if any).
'''Q) What are the differences from vanilla Ingo Molnar's patch?''' <<BR>>
A) A simple adaptation to the BenC's kernel git tree isn't the only difference: We work on Ubuntu specific code or drivers (aka linux-ubuntu-modules/linux-restricted-modules) and also remove all code which isn't strictly related to real-time preemption support (if any).
Line 100: Line 81:
'''Q) What features will be included in Ubuntu rt kernel flavour?''' [[BR]] '''Q) What features will be included in Ubuntu rt kernel flavour?''' <<BR>>
Line 103: Line 84:
'''Q) How to get the source code? Is there a Git repository?''' [[BR]]
A) (I belive there is no Git repository. The best way is, I guess, get the Ubuntu kernel from the Git repository at http://kernel.ubuntu.com and then apply the patch from Ingo Molnar. Is there a patch package? Alessio, could you please elaborate on this?)
'''Q) How to get the source code? Is there a Git repository?''' <<BR>>
A) Sure! You can find it at [[http://kernel.ubuntu.com/git|Ubuntu Kernel Team's Git Repositories]].


'''Q) Why is SMP disabled''' <<BR>>
A) See bug report [[https://bugs.launchpad.net/ubuntu/+source/linux-rt/+bug/290498|290498]] and its duplicates (Do you know more on this subject? Please write a note here!).
Line 108: Line 93:
*) Team creation? [[BR]]
Collaboration with instant messaging, chat or mailing list? [[BR]]
    I would prefer using a mailing list for team collaboration. [[wiki:DeraldWoods Derald]] [[BR]]
    Ideally a forum; else a mailing list; else a permanent, logged IRC chat room. [[wiki:PeterLJones Peter]] [[BR]]
    I actually prefer a mailing list but a forum would also be OK. [[wiki:miguel Miguel]] [[BR]]
    I would prefer mailing list but IRC Chat root is also useful for me. [[wiki:AlessioIgorBogani Alessio]]

*) PolicyKit, framework for secure privilege elevation integration, seems which became default in Hardy. Investigate on possible integration. [[BR]]

*) Backport of the last upstream code? [[BR]]
It is necessary define a tool/method to track rt development and thus eventually backport useful bits.

 * Packaging the '''rt-tests''' utilities. [[http://rt.wiki.kernel.org/index.php/Cyclictest cyclictest/signaltest]] [[http://rt.wiki.kernel.org/index.php/Preemption_Test preemption test]] [[http://devresources.linux-foundation.org/craiger/hackbench/ hackbench]]

*) Debug packages? [[BR]]
See at https://blueprints.launchpad.net/ubuntu/+spec/daily-kernel-builds

There are some other test applications on http://rt.wiki.kernel.org that could also be integrated in a future test suite. And, of course, this test suite could be executed daily, integrated in the daily-kernel-builds referred above. [[wiki:miguel Miguel]]

In this way you testing realtime performance of the buildd server (the Ubuntu server that compile kernel). Testing is a very useful things but it is necessary find an other way for do it. [[wiki:AlessioIgorBogani Alessio]]

*) RT documentation? [[BR]]
I believe that it would be necessary to have some documentation package, at least for application developers. As a starting point, the documentation in the http://rt.wiki.kernel.org could be used but I think that something for newcomers should also be written (in cooperation with the http://rt.wiki.kernel.org maintainers, of course).

Good suggestion! [[wiki:AlessioIgorBogani Alessio]]

Need to review: [[BR]]
1. High precision timers don't work on machine which have only PIT as souce clock [http://www.mail-archive.com/linux-rt-users@vger.kernel.org/msg00375.html more info] [[BR]]
2. The realtime kernel could expose you to security issues[[BR]]
3. On some machine esd with realtime kernel freeze GNOME (please kill esd and relaunch it after)[[BR]]
4. Restricted modules could increase latencies (please buy only hardware which have a free driver!) [[BR]]


 * Any suggestions/feedbacks/requests? [wiki:AlessioIgorBogani Alessio] [[BR]][[BR]]
 * Any suggestions/feedbacks/requests? [[AlessioIgorBogani|Alessio]] <<BR>><<BR>>
 * Is it available for i386, amd64 and ppc ?
   Unfortunately only i386 and amd64 are available so no ppc rt kernel flavour at the moment due to lack of resources (mainly ppc systems!)

Please check the status of this specification in Launchpad before editing it. If it is Approved, contact the Assignee or another knowledgeable person before making changes.

Summary

This specification details the plan to improve hard real time support in Ubuntu Hardy. In particular, to comply with quality levels that users want from an LTS release.

Rationale

In order to push Ubuntu in very highly demanding business (e.g. industrial automation, financial, robotics, advanced multimedia and telco) and other contexts, it is necessary to improve real-time kernel flavour support.

Use Cases

1. Deterministic (Hard-Realtime) [Industrial Control, Robotics, Automation, DAQ, etc.]

  • Alex is developing an application (SCADA type) for a customer and he would be very happy to use Linux and Ubuntu for the deployment.

  • John is using the Ubuntu distribution, with the linux-rt kernel, as the RTOS, for a GANTRY type widget assembly application. The system has digital I/O, servo motors, and GPIB instrumentation.

2. Non-Deterministic (Low-Latency) [Data Sampling, Analysis Tools, Realtime Monitoring, etc.]

  • Beth is a user wanting application stability but with real-time performance capability for running Audio and MIDI applications (such as JACK and its clients). This could include running a full X/Gtk UI stack with Wine and/or FST, with networking to allow for collaborative performances (e.g. NINJAM). Stability: must be reliable enough for live performance (system hangs look terribly unprofessional). Performance: no dropped MIDI messages (hanging notes suck...), no dropped audio frames (audio glitches suck...).

Scope

This specification covers the rt linux kernel flavour in Ubuntu.

Implementation

We will use the new kernel build system created by the Ubuntu Kernel Team for production kernel: More nformation about it.

Rt-tests packages will be released through Alessio's PPA archive.

We use Git for handle kernel source code and Quilt for handle the preempt-rt one.

Other utilities as like Preemption test or hackbench are postponed to hardy+1. It is the same for integration with PolicyKit (framework for secure privilege elevation integration) and for RT related documentation due to lack of interest.

Outstanding Issues

1. High precision timers don't work on machine which have only PIT as souce clock more info
2. The realtime kernel could expose you to security issues (probably local only)
3. Restricted modules increase latencies (please buy only hardware which have a free driver!)

Packages available

Packages available in Hardy archive:
linux-rt
linux-image-rt
linux-image-2.6.24-16-rt
linux-ubuntu-modules-2.6.24-16-rt
linux-headers-rt
linux-headers-2.6.24-16-rt
linux-restricted-modules-rt
linux-restricted-modules-2.6.24-16-rt
linux-backports-modules-rt
linux-backports-modules-hardy-rt
linux-backports-modules-2.6.24-16-rt

Packages available in Alessio's PPA archive:
rt-tests

FAQ

Q) Did you manage to include all the regular Ubuntu kernel patches in it? If not, is it possible to know what was left out?
A) We use _only_ the full Ubuntu Kernel (not vanilla, not custom version or other). The Ubuntu Realtime kernel is the Ubuntu Kernel plus the real-time pre-emption patch. Also the configuration (aka /boot/config*) is the same except for specific real-time options.

Q) Where can I find documentation?
A) All existing docs are available on http://rt.wiki.kernel.org

Q) What are the differences from vanilla Ingo Molnar's patch?
A) A simple adaptation to the BenC's kernel git tree isn't the only difference: We work on Ubuntu specific code or drivers (aka linux-ubuntu-modules/linux-restricted-modules) and also remove all code which isn't strictly related to real-time preemption support (if any).

Q) What features will be included in Ubuntu rt kernel flavour?
A) CPU shielding, priority inheritance, sleeping spinlocks, interrupt threads and high-resolution timers and CFS optimizations.

Q) How to get the source code? Is there a Git repository?
A) Sure! You can find it at Ubuntu Kernel Team's Git Repositories.

Q) Why is SMP disabled
A) See bug report 290498 and its duplicates (Do you know more on this subject? Please write a note here!).

BoF agenda and discussion

  • Any suggestions/feedbacks/requests? Alessio

  • Is it available for i386, amd64 and ppc ?
    • Unfortunately only i386 and amd64 are available so no ppc rt kernel flavour at the moment due to lack of resources (mainly ppc systems!)


CategorySpec

RealTime/Hardy (last edited 2008-11-07 15:34:02 by d83-183-69-42)