Transcode Forge

New year, new status update! Transcode 1.2.0 is on its way to the first alpha, which is due for the end of the month (20100131). Except for the expected huge pile of fixes, documentation and polishing, the alpha cycle will also bring the planned ALSA improvement and hopefully a first DVB import module.

The 1.2.0 cycle is a big leap forward for transcode, featuring an export layer rewritten from scratch (an early preview was delivered, disabled by default, on the 1.1.x releases), a real, stackable profile system, modules autodetection from format, keyed arguments, better introspection tools and the usual bunch of updates all around the places. The new features of the 1.2.0 release outlined above will likely be covered in detail by a serie of articles.

In order to foster and ease the (early) adoption of the 1.2.0, this release also features (and yes, it's already avalaible on HG) the versioned installation. Using this feature, transcode is installed with the version suffix automatically appended to all important installed objects, so you can easily get both transcode 1.1.x and 1.2.x on the same system. That was of course possible with earlier versions, but with a significant more effort.

Yes, we're alive and kickin'! And transcode 1.1.5 is available for download. This is the fifth maintenance relase of the 1.1.x branch. This releases include minor feature enhancements.

Highlights of the changes since 1.1.4:

[*] Add a special-crafted import module targeting webcams using libv4l.

[+] Fixed the colorspace detection into import_v4l2.

[*] tcdemux: drop the builtin limit of streams selectable for passthrough.

[*] Fixed the x264 module to work with libx264 >= 76.

[*] Update the video stabilization plugins to version 0.61.

[*] Made libmpeg2 an optional dependency (libmpeg2convert is needed too).

Key:
[+] feature added.
[!] bugfix of an existing feature.
[*] changement/improvement (not bugfix) of an existing feature.
[-] feature dropped.

transcode 1.1.4 is available for download. This is the fourth maintenance relase of the 1.1.x branch. This release includes the hotfixes for two recently reported serious bugs.

Highlights of the changes since 1.1.3:

[!] Fixed the build system to comply with autoconf 2.64.

[!] Fixed bugs: #16046.

Key:
[+] feature added.
[!] bugfix of an existing feature.
[*] changement/improvement (not bugfix) of an existing feature.
[-] feature dropped.

One of the unwanted, while expected, side-effects of the introduction of the NMS is the explosion of testcases due to the bunch of new, smaller, modules written during the transition. More modules mean more interactions, and thus more testing needed. As found in current HG, we have eight muxer modules and twelve encoder modules. Not all combinations make sense, but we still have roughly fourthy combinations to test. Unfortunately, some schedule glitches and, most important, the neverending lack of developer time exhacerbated this issue, so we ended down with a bunch of new, poorly tested, modules committed to HG. The exit strategy is simple: first, to prioritize the module combinations; second, to automatize as much as possible the test job.

To prioritize the module combinations means to test first the mostly used module combinations. I extracted the first round of them, which will be debugged and tested first (but not in this order). More will come later.

Key: left, the nickname of the combo; right, the combo itself, as video encoder/audio encoder/multiplexor[/auxiliary multiplexor (if any)].

streamdump: copy/copy/y4m/wav

rawdump: copy/copy/raw

avixvid: xvid/lame/avi

avilavc: lavc/lame/avi

lzorec: lzo/copy/avi

gmjpeg: im/copy/avi

gmdump1: im/null/raw

gmdump2: im/copy/raw

xiph: theora/vorbis/ogg

mpegogg: xvid/lame/ogg

xiphmpeg: xvid/vorbis/ogg

More on this topic in the future posts.

Long time no post, so it's time for a new status report for the upcoming 1.2.0 release.

Quick Summary

The overall progress of the new release is fairly good. All the big changes and the invasive patches (except for bugs :^)) have been committed to the default branch. As will be outlined below, the release is mostly feature complete; however, some aspects and some important modules have still to pass an intensive review. Two more important tasks are still ongoing, tests and documentation.

Let's update the tasks outlined into the 1.2.0 roadmap

import_alsa power up (PENDING):
Still pending. Small task, no core changes scheduled.

import_v4l2 tuning support (DONE!):
The code was committed to default branch and was also backported to the 1.1.2 release. This code is in fairly good shape, anyway further testing it is always appreciated.

Deep review of tcframe* (DELAYED):
Delayed for 1.3.0 or beyond.

Split libtc in smaller libraries (DONE!):
No regressions so far; Documentation and bugfixing still in progress.

NMS-compliant export layer (DONE!):
As it is found into the default branch, transcode has now only a NMS-powered export layer. The introduction of a proper, NMS-powered, export layer triggered various others invasive changes, like a module API refresh, the introduction of a new support library (libtcexport), the introduction of a new part of libtcmodule (the module registry), the renewal of the tcexport support tool and so on. At this moment, we're actively testing, tuning and documenting all the new code.

Import the Synchronizer patch into HEAD (DONE!):
The code was committed some time ago and still needs some tuning. The code is in fairly good shape, anyway further testing it is always appreciated.

Switch to graphicsmagick (http://www.graphicsmagick.org/) (DONE!):
The code was committed and needs some intensive testing. Regressions are possible and expected, but they will be fixed. The code is in fairly good shape, anyway further testing it is always appreciated.

transcode 1.1.3 is available for download. This is the third maintenance relase of the 1.1.x branch.

Highlights of the changes since 1.1.2:

[+] Support for CubicKeys4 and Sinc8 zoom algorithms.

[*] Support for input selection/channel tuning into import_v4l2 (backport from the 1.2.x branch)

[!] Fixed spurious write warnings when using -y *,tcaud (regression from 1.0).

[!] Fixed bugs: #15302, #15306, #15351, #15502, #15825, #15615.

Key:
[+] feature added.
[!] bugfix of an existing feature.
[*] changement/improvement (not bugfix) of an existing feature.
[-] feature dropped.

(already posted on the transcode-devel mailing list)
The main feature of the next 1.2.0 release will be the introduction of a full-NMS export layer, providing all the long-needed goodies like support for modern codecs/formats.

Back in january, that was the 1.2.0 roadmap

import_alsa power up.

import_v4l2 tuning support.

Deep review of tcframe*.

Split libtc in smaller libraries.

NMS-compliant export layer.

Import the Synchronizer patch into HEAD.

switch to graphicksmagic (http://www.graphicsmagick.org/).

As is found on today's HG, the following is the current status:

import_alsa power up:
To be done. It's a small task, anyway.

import_v4l2 tuning support:
DONE! Already fairly stable. Needs more testing, though.

Deep review of tcframe*:
Delayed for 1.3.0 or beyond.

Split libtc in smaller libraries:
DONE! No regressions so far; needs more documentation, even though the avalible one is pretty decent. Some minor bugs can still spawn whatsoever.

NMS-compliant export layer:
I actively searched for design flaws into current architecture, (of course) found some of them, addressed then solved. All that is nice, but that required (and requires) some time. The whole thing it's coming along pretty nice, however. All the preview modules so far published will still work of course, and new ones are coming (libavformat muxer support, mkv direct support very likely). The merger with public repo is not too distant into the future, but some weeks more for development are still needed.

Import the Synchronizer patch into HEAD:
DONE! Still needs testing and tuning. No regressions spotted so far, but wider testing can eventually let them pop out.

Switch to graphicsmagick (http://www.graphicsmagick.org/):
Testing just beginned, expect problems e.g. from the affected filters (especially).

Short term plans:
Focus on NMS and merge the code as soon as possible. After that, most of the development is done, the remaining bits are self contained (mostly modules).

A first 1.2.0 alpha version will be (hopefully) released this summer.

transcode 1.1.2 is avalaible for download. This is the second maintenance relase of the 1.1.x branch. Beside the usual round of fixes, this is the first releases which can be built without ffmpeg.

Highlights of the changes since 1.1.1:

[!] Make the -W option work again like 1.0.x branch.

[!] Proper handling of the alpha data in filter_logoaway (avoid segfault).

[!] Fixed bugs: #15007, #15441.

[*] Allow to build x264 experimental encoder with last libx264 snapshots.

[*] Allow to build transcode without FFmpeg.

[!] Removed outdated libav* information from the FAQ.

Key:
[+] feature added.
[!] bugfix of an existing feature.
[*] changement/improvement (not bugfix) of an existing feature.
[-] feature dropped.

A large series of patches is being committed into HG default branch. This patchset implements the support of the GraphicsMagick libraries (from 1.1 to onwards), while on the same time ImageMagick is being phased out. The 1.2.0 release is scheduled to be the first one requiring GraphicsMagick; however, it is possible that the patchset will be backported, once stabilized, into 1.1.x series.

The rationale for this switch is outlined by some highlights of the GraphicsMagick homepage:

GM is much smaller and tighter.

GM does not does not conflict with other installed software.

GM suffers from fewer security issues and exploits.

GM comes with a comprehensive manual page.

GM provides API and ABI stability and managed releases that you can count on.

Find out about GraphicsMagick on the project website.

The ffmpeg libraries are an historical pillar of transcode, providing much used and appreciated export and import modules. However, transcode claim its independency from FFmpeg. So, starting from the approaching 1.1.2 release, it will be possible to build transcode without FFmpeg support. Of course, given the quality and quantity of the features that FFmpeg provides, this is highly discouraged and disabled by default.

transcode 1.1.1 is avalaible for download. This is the first maintenance relase of the 1.1.x branch.

Highlights of the changes since 1.1.0:

[*] Switched to new, terse ChangeLog format.

[-] The import_imlist module is deprecated. Use --multi_input -x im instead.

[*] Allow the dectectclipping filter to use a log file.

[*] Big YAIT update by Allan Snider.

[*] Added `frame' option to filter_text.

[!] Resolved tcmodinfo linking/loading problems.

[!] Fixed bugs: #15181, #15239

Key:
[+] feature added.
[!] bugfix of an existing feature.
[*] changement/improvement (not bugfix) of an existing feature.
[-] feature dropped.

Starting from this week the codebase moved on Mercurial (HG). The usage of a distributed VCS helps quite a lot the development process. The source code can be accessed here: http://hg.berlios.de/repos/tcforge

The full history of the project was imported from the previous repository, hosted on cvs.exit1.org. The SVN repository is still active for historical purposes; it will also serve as auxiliary space for side projects (e.g. tcrund).

transcode 1.1.0 final is avalaible for download. This is the final relase of transcode 1.1.0, released after two years and counting of development.

We are happy to announce the first release of new transcode development cycle. A strong effort was made to laid down robust foundations fort further great ehnachments, opening the road for long-waited and exciting features.
EVERYONE is using early 1.1.0 prereleases or HEAD snapshots it is encouraged to try this release. 1.0.x users are also encouraged to switch, or to give a try at very least.

Highlights of the changes since 1.1.0 RC 5:

tcrequant is now deprecated and not built by default.

Highlights of the changes since 1.0:

command line options reorganization.

module set reorganization: dropped unused/duplicate modules.

YUV420P is now the default preferred colorspace.

new output modes for tcprobe (extended, raw).

new multiple input mode (experimental).

new encoders and muxers (experimental).

PVM3 is now officially deprecated.

tcrequant is now officially deprecated.

manpage split (transcode_import, transcode_filter, transcode_export).

new modules: import_vag (decodes VAG audio from PlayStation), import_pv3 (PV3 audio/video streams), filter_yait (advanced, two-step inverse telecine filter contributed by Allan Snider), filter_stabilize/filter_transform (video stabilization filters contributed by Georg Martius).

improved modules: import_mplayer (better autodetection and integration (see --mplayer_probe option)), import_avi (internal colorspace conversion for raw content), filter_logo (various enhancements contributed by Sebastian Kun), *_lzo (ported to liblzo version 2), import_vob (new `nodemux' option. Improve A/V sync in some corner cases), import_ffmpeg (new `nopad' option. Fixes padding autodetection in some corner cases).

massive internal reorganization: huge cleanup, better libraries, tons of docs, refactoring, growing testsuite.

tons of bugfixes.

See the full Release Notes for further information. See the ChangeLog for full detailed change list.

transcode 1.1.0 rc 5 is avalaible for download.

This release candidate was due to a bug found on --psu_mode. Except for further critical bug, this is the last RC before 1.1.0 final.
EVERYONE is using early 1.1.0 prereleases or HEAD snapshots it is encouraged to try this release. PLEASE help also report any bug or regression found using the bugtracker (link above) or the transcode-devel mailing list (the first way is the preferred way).

Highlights of the changes since 1.1.0 RC 4:

Fixed the --psu_mode hangup.

Fixed a bug causing a segfault with lame encoder when output is rotated.

Fix compilation of avilib under MacOsX.

Fixed the processing slot for filter_stabilize/transform

--no_log_color -> --log_no_color for consistency (with HEAD).

Safely skip '.' and '..' without warning when probing a directory.

minor fixes.

A recently-reported bug in PSU mode (http://article.gmane.org/gmane.comp.video.transcode.devel/4763) eventually showed up a serious design flaw into current framebuffer code (affects all modern branches: 1.1.0, CVS HEAD, SVN). Unfortunately, this issue can't be quickly fixed, so some serious changes are needed, as well as a new RC which is expected in the early days of 2009. The 1.1.0 RC final is due a couple of weeks after. The new (candidate) release date for 1.1.0 final is then 2009/01/18.

Long time no post. But hey, it's Christmas, and as little present I'd like to give a little status report about what's going on here on transcode forge.

transcode 1.1.0: the important things first ;). The good news is there aren't any news :) the release is on track and really looks like the schedule will be respected. All problems emerged during RC cycle are been addressed (file a bug if not!), nothing scary seen so far.

transcode 1.2.0: it is half-way done. Really. Coding is 99% complete, we're entering in test phase. 1.2.0 final is expected (realistically) for September 2009, and the RC cycle will hopefully start on early summer.

transcode 1.0.x: all is calm and quiet. So far, so good. The support for 1.0.x branch is planned to end as 1.2.0 released.

tcrund: the transcode runtime control daemon is progressing nicely and will be released during the early 2009. Nothing revolutionary, just a little cool addition (and a nice thing to code :)).

dirac: the dirac codec (http://diracvideo.org) looks very promising. Adding to transcode is one pet project of mine, but this will likely happen after 1.2.0 released.

mpeglib: still on hiatus. Will be hopefully rebooted during 2009, the only thing lacking is developer time, as usual.

For any question, request or further discussion. Drop us a mail on transcode-devel-at-exit1-dot-org. Happy Holydays!

transcode 1.1.0 rc 4 is avalaible for download.

This is the last scheduled release candidate of transcode 1.1.0.
EVERYONE is using early 1.1.0 prereleases or HEAD snapshots it is encouraged to try this release. PLEASE help also report any bug or regression found using the bugtracker (link above) or the transcode-devel mailing list (the first way is the preferred way).

Highlights of the changes since 1.1.0 RC 3:

More tests, small enhancements and fixes backported from HEAD.

Fixed ImageMagick check in configure.Provide up-to-date FFMpeg instructions in INSTALL file.

Merge stabilization plugin version 0.44. Code courtesy of Georg Martius

Reduce the YUV422 confusion. Made clear that UYVY support was removed, and YUV422P is introduced. Now YUV422=YUV422P.

Cleanup encode fields handling in export_ffmpeg.

Build fix for avilib on Big Endian arches (PPC).

Align import_v4l with HEAD (new module version).

Update RELEASE NOTES to last changes.

transcode 1.0.7 is avalaible for download.

This is the final release of transcode 1.0.7.
This release is expected to compile (and work, of course ;) ) cleanly on: x86, x86_64.

Highlights of the changes since 1.0.6:

Update the code to be in sync with lastest FFmpeg API changes.

Bump FFmpeg requirements. Now transcode needs a recent (between r13582 and r15261; later versions are just untested) snapshot of FFmpeg to work.

Fix an avilib x86_64 portability problem which caused avifix problems.

Static linking of libavcodec is now definitively unsupported.

transcode 1.1.0 rc 3 is avalaible for download.

This release updates avilib (the internal AVI file handling library) to last CVS changes and fixes the compilation problems encountered on the 1.1.0 RC 2 release.