BBC Redux

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

BBC Redux is a BBC Research & Development system that digitally records[1] television and radio output in the United Kingdom produced by the British Broadcasting Corporation.[2]:2 It has been operating since 2007[1] and contains several petabytes of recordings[1] and subtitle data.[1] It is notable for being the proof of concept for the Flash video streaming version of the BBC iPlayer.[2]:15

It is an internal research project developed for testing[3][4][5] which acts as a giant video on demand or personal video recorder (PVR).[3] It contains a complete digital archive, recording both television and radio twenty-four hours a day, of all of the BBC's national and also some regional broadcast output since mid-2007,[6][7] and is automatically compiled without human input.[2]:5[5] The BBC stated that BBC Redux is one of its major contributions to the field of digital archiving and preservation.[8]

Some accounts for accessing the system on a temporary basis were made available at Mashed 08[9] and again at Culture Hack Day 2011,[10] providing streaming-only access to BBC content broadcast during the weekend of the event.[11] As well as streaming, the system enables high-quality downloads of television and radio content,[12] and has had the option to download subtitles from programmes since 2008.[13]

BBC Redux had originally been developed at the BBC's Kingswood Warren campus,[14] in only two months,[15] and with the investment required being significantly less than the iPlayer.[5] The saved content can be used for broadcast compliance checking[2]:16 and by BBC programme researchers.[16] As of 2012, BBC Redux is only available to employees, because existing legal contracts with content producers limit how material can be broadcast, distributed and made available to general consumers.[17][18] The Readme file for associated API frameworks hosted on GitHub states:

BBC Snippets and BBC Redux are tools designed to allow BBC staff to develop new ways to view and navigate content. As such, they're not open to the public.[19]

Technical details[edit]

The system records over 100 megabits per second, continuously.[2]:3 As of August 2011, BBC Redux contained 300,000 hours of recorded audio and video.[20] Not all regional variations are recorded; for BBC One, only London and Northern Ireland variants are recorded.[21]

A series of standard Digital Video Broadcasting terrestrial antennas and satellite dishes, coupled to DVB-T and DVB-S TV tuner cards are used to capture the incoming DVB multiplexes[18] transmitted for over-the-air Freesat and Freeview terrestrial television.[2]:5 These raw MPEG transport streams are split into single-programme MPEG transport streams, encapsulated in RTP, and sent using UDP IP multicast within the IPv4 multicast address range 233.122.227.0/24 from AS31459.[2]:5 From the multicast streams individual television programmes can be extracted and saved, without requiring any transcoding or conversion of the contained MPEG-2 video data.[2]:5

As of May 2009, racks of Sun Fire T1000 and T2000 machines were used acquiring and storing the incoming programmes respectively; while commodity x86-64 computers were used for database operations and playback transcoding.[2]:4 The T2000 storage nodes are connected by 10 Gigabit Ethernet on the network side,[2]:7 and then by serial attached SCSI to RAID boxes containing high-capacity commodity Serial ATA hard disk drives.[2]:7 The "fsck-free" ZFS file system is used after experiments with Unix File System (UFS) proved it to be too slow.[2]:8 Sun Microsystems had to manually repair the filesystems on two occasions using Unix dd.[2]:11–13

The software is based on open source technologies,[5] and uses a combination of mod_perl and C running on OpenSolaris.[2]:9,14 A series of "lolcat" images are used for the system's HTTP 404 and error pages.[22]

Projects[edit]

As part of the European Union (EU) "NoTube" project running between 2009–12. a recommendation research system using Lonclass categorisation and Tanimoto coefficient matching was tested by the BBC R&D Audience Experience team and integrated with 23,000 recordings delivered from Redux.[23] The matching dataset was gathered over a period of five months.[24]

For a BBC Digital Media Initiative (DMI) demonstration entitled "Million Minutes", files from the BBC's D-3 video tape archive were imported into the Redux system during 2009–2010.[16] This also used commercial software from Artesia Digital Media Group and involved creating a representational state transfer (REST) interface onto the content stored within Redux.[25]

During 2010, Safari[26] and Google Chrome[27] browser extensions were developed to integrate Redux content with the main www.bbc.co.uk/programmes directory.[28]

In January 2012, the BBC's Multimedia Classification team announced they were hoping to test and add "mood-based navigation" to the existing BBC Redux interface,[29][30][31] along with audience measurement and other rich metadata comprising work part-funded by the Technology Strategy Board.[6] During 2010–2011 BBC Research and Development integrated content archived in BBC Redux with the BBC's existing internal BBC InFax system, allowing finding of metadata and archive content within the same browser window,[32] covering news and subtitles from over the previous five years.[33]

During March 2012, the Atlas index changed the method of equivalence matching used for indexing against BBC Redux.[34]

References[edit]

  1. ^ a b c d Solon, Olivia (16 June 2011). "The people and projects inside the BBC's vast R&D lab". Wired. Retrieved 12 May 2012. 
  2. ^ a b c d e f g h i j k l m n Bird, Tom (28 May 2009). "BBC Redux" (PDF). Sheffield: UKNOF 13: 2–16. 
  3. ^ a b Butterworth, Brandon (27 October 2008). "History of the 'BBC Redux' project". BBC Internet Blog. Retrieved 12 May 2012. 
  4. ^ Saran, Cliff (20 April 2012). "BBC wants to build a cultural API". ComputerWeekly.com. Retrieved 13 May 2012. an internal version of BBC iPlayer called Redux, which was originally developed for testing 
  5. ^ a b c d Rose, Anthony (2008). Kozamernik, F., ed. "Evolution of the BBC iPlayer" (PDF). EBU Technical Review. European Broadcasting Union (Q4): 2. Retrieved 13 May 2012. ;
    Rose, Anthony (24 February 2009). Kozamernik, F., ed. "Evolution of the BBC iPlayer" (PDF). EBU Technical Review. European Broadcasting Union (The Best of 2008): 5. Retrieved 13 May 2012. 
  6. ^ a b Tinley, Dominic (8 November 2011). "ABC-IP and work on audio archiving research". BBC Research & Development Blog. 
  7. ^ Tweed, Jonathan (7 November 2011). "Introducing Tellytopic: Navigating programme archives by topic". MetaBroadcast. Retrieved 13 May 2012. BBC Redux, a playable archive of almost everything broadcast since mid-2007 
  8. ^ Wright, Richard (16 June 2010). "The Value of Everything". BBC Research & Development Blog. 
  9. ^ Johnson, Bobbie (26 June 2008). "Hackers fan the flames of imagination at Mashed". The Guardian. Retrieved 13 May 2012. 
  10. ^ Williams, Dan W. (14 January 2011). "BBC Archive − A number of Redux accounts giving…". Tumblr. 
  11. ^ "Datasets". Culture Hack Day. 14 January 2011. 
  12. ^ "Programme" (PDF). Geneva: European Broadcasting Union. 24 September 2008. Retrieved 20 May 2012. BBC Research developed a Redux site enabling a high quality download service of some BBC TV products. 
  13. ^ "BBC Redux". Mashed 08. Backnetwork. Madgex. 2008. 
  14. ^ Forrester, Ian (14 March 2011). "Goodbye Kingswood warren". Cubic Garden. 
  15. ^ Singleton, Alex (May 2008) [13 March 2008]. "Linux at the BBC" (Platform-neutral content). Linux Format (105): 50. Brandon Butterworth explains: 'People thought it would be really difficult to run on all platforms, that it would take years to develop. But I led a team to do a Flash version that would work on Linux and we did it in two months' 
  16. ^ a b Highlights of the Year (PDF). BBC R&D Annual Review 2009–2010 (Report). 10 March 2011. p. 4. Retrieved 13 May 2012. 
  17. ^ Rivera, Ralph (11 May 2012). "BBC Online Briefing: Spring 2012 Final Q&A" (television question and answer session, offset 23:28–28:30). BBC Internet Blog. 
  18. ^ a b Tinworth, Adam (20 April 2012). "The UK's cultural heritage as digital public space". One Man and His Blog. Retrieved 13 May 2012. BBC Redux is iPlayer on steroids – with an API. It records the whole digital multiplex, … But the rights are complicated- because the BBC doesn't own many of the programmes it broadcasts. 
  19. ^ Haynes, Matt (25 January 2012). "README.md". redux-client-ruby. GitHub. Retrieved 13 May 2012. 
  20. ^ Davies, Sam; Bland, Denise (1 August 2011). "BBC R&D – Archives Research" (PDF). p. 4. Retrieved 13 May 2012. 
  21. ^ Northwood, Chris (17 May 2012). "Gah, Redux only records BBC One London;". @cnorthwood. Twitter. Retrieved 20 May 2012. 
  22. ^ Eden, Terence (30 September 2011). "I do like the BBC Redux 404 page". @edent. Twitter. 
  23. ^ "NoTube Archive Browser Experiment 1". NoTube Archive Browser. 19 December 2011. Retrieved 13 May 2012. 
  24. ^ Miller, Libby (14 October 2011). "Algorithms for recommendations in various N-Screen implementations". NoTube. Retrieved 15 May 2012. 
  25. ^ James, Bruce (5 November 2009). "ArcHak". CustardCat. Retrieved 13 May 2012. 
  26. ^ Starling, Sam (4 September 2011). "README.md". Safari-Redux-Switcher. GitHub. Retrieved 15 May 2012. 
  27. ^ Robertson, Duncan (26 August 2010). "README.md". Redux Switcher. GitHub. Retrieved 15 May 2012. 
  28. ^ "Prototyping Weeknotes #29". BBC Research & Development Blog. 27 August 2010. Retrieved 13 May 2012. 
  29. ^ DTG Staff (18 January 2012). "BBC R&D develops 'mood based navigation'". News. Digital TV Group. 
  30. ^ Campbell, Rosie (16 January 2012). "An Affective Interface for Mood-Based Navigation". BBC Research & Development Blog. Retrieved 13 May 2012. 
  31. ^ BBC Research and Development. "Multimedia Classification". Projects. Retrieved 13 May 2012. User Evaluation on BBC Redux (by BBC staff) … 
  32. ^ Highlights of the Year (PDF). BBC R&D Annual Report 2010–2011 (Report). 15 November 2011. p. 5. 
  33. ^ McAthy, Rachel (20 April 2012). "#ODCC – Open data and the 'new digital fields of exchange'". Journalism.co.uk. Mousetrap Media Ltd. 
  34. ^ Tweed, Jonathan (21 March 2012). "Atlas release notes - week to 20th March". MetaBroadcast. Retrieved 15 May 2012. Changes to the behaviour of BBC Redux equivalence 

External links[edit]

Retrieved from "https://en.wikipedia.org/w/index.php?title=BBC_Redux&oldid=808062322"