LinHES Forums
http://forum.linhes.org/

could SVN code have borked my Mytharchive?
http://forum.linhes.org/viewtopic.php?f=6&t=16698
Page 1 of 1

Author:  neutron68 [ Sun Sep 23, 2007 4:20 pm ]
Post subject:  could SVN code have borked my Mytharchive?

At present, I am still running R5F1 - with the Schedules Direct modification that Cecil provided to us in the thread http://www.mysettopbox.tv/phpBB2/viewtopic.php?t=16178

After that modification, everything seemed to work fine. Then, a few nights ago, I wanted to burn a DVD using MythArchive and it screwed it up. (Mytharchive was working fine before the SVN update I mentioned.) The program I wanted to burn was 1.6GB in size. The DVD output only had a 43MB file on it! I looked in the /myth/tmp/work folder and the dvd file structure stored there also had the same 43MB video file. So it was not a burning error, but a MythArchive error in creating the DVD video sturcture.

Has anyone else seen this problem with SVN code breaking your MythArchive?
Would it fix MythArchive to do the SVN code download/recompile again today with the thought that the SVN code of today is different than the SVN code of 3 weeks ago?

Insight appreciated,
Eric

Author:  neutron68 [ Wed Sep 26, 2007 9:36 am ]
Post subject:  more info

Of note, I just tried another DVD creation and chose a different video file. This time, it worked - with no changes to the system.

So, this makes me wonder if there was some mpeg video errors in the source video file that failed to produce a complete DVD.

Sound like a reasonable theory based on the evidence?

Eric

Author:  lantz [ Wed Sep 26, 2007 4:02 pm ]
Post subject:  Re: more info

neutron68 wrote:
So, this makes me wonder if there was some mpeg video errors in the source video file that failed to produce a complete DVD.

Sound like a reasonable theory based on the evidence?


Wouldn't surprise me, particularly if it's HDTV. I had a heck of a time getting HDTV to work every time with mytharchive (and the tools it uses by default).

An easy way to check would be to redo the file (maybe with just create iso instead of burn dvd checked to save you a coaster) and see if any of the files created in the /myth/tmp/work/#/ directory is cut off.

Also, you could try looking in the /myth/tmp/logs directory at progress.log or mytharchive.log (one of them has more detail than the other) files and see if any particular errors pop up.

Author:  neutron68 [ Wed Sep 26, 2007 4:43 pm ]
Post subject:  yes and no

Yes, it is a DTV recording (digital tv via the HD-3000 card) but it was a standard definition broadcast from our standard definition PBS DTV channel. I recorded the standard definition broadcast so I could share the program with HD-impared friends.

I tried MythArchive twice on that recording and both times it produced a full length video file in the /myth/tmp/work/# directory but a truncated file in the /myth/tmp/work/dvd directory.

I took the same recording and transferred over to the Windoze machine and used Ulead DVD Movie Factory to make a dvd - that worked fine.

I'll see if there is any leftovers from the failed dvd creation attempt in the /myth/tmp/logs directory.

Eric
edited to fix spelling errors :)

Author:  lantz [ Thu Sep 27, 2007 11:29 am ]
Post subject:  Re: yes and no

neutron68 wrote:
I recorded the standard definition broadcase it so I could share the program with HD-impared friends

I tried MythArchive twice on that recording and both times it produced a full length video file in the /myth/tmp/work/# directory but a truncated file in the /myth/tmp/work/dvd directory.


Well, just as a side note, since you're encoding the content into DVD format anyways, you can use HD sourced content for your HD-impaired friends.

There should be multiple files in the work/# directory. The stream* files are the demuxed audio and video streams used to create the DVD video file. Playing them with xine or mplayer might shed some light if the video file is truncated.

Author:  neutron68 [ Thu Sep 27, 2007 12:49 pm ]
Post subject:  Re: yes and no

lantz wrote:
Well, just as a side note, since you're encoding the content into DVD format anyways, you can use HD sourced content for your HD-impaired friends.

Really? MythArchive will transcode a recorded HDTV file down to a standard definition file and burn a dvd of it right out of the box? (meaning there are no extra scripts that I have to write and run) :o

Author:  lantz [ Fri Sep 28, 2007 11:01 am ]
Post subject:  Re: yes and no

neutron68 wrote:
transcode a recorded HDTV file down to a standard definition file and burn a dvd of it right out of the box?


Well, the reason is that DVD's aren't HD themselves.

Any DVD-Video mytharchive creates follows the standards. The biggest component to mytharchive and the tools it using (IMHO) is to translate whatever format video you give it into the very strict formats allowed by the DVD-Video standards.

Author:  neutron68 [ Fri Sep 28, 2007 1:05 pm ]
Post subject:  Re: yes and no

lantz wrote:
neutron68 wrote:
transcode a recorded HDTV file down to a standard definition file and burn a dvd of it right out of the box?


Well, the reason is that DVD's aren't HD themselves.

Correct. Video DVDs are SD by definition.
I simply was not aware that MythArchive had the ability to transcode HDTV down to SD. I'll test it soon!

At present, I use Roxio 8 do my HDTV to SD transcoding for DVD creation. The output SD video isn't without problems, but in my experience, it produces the best looking SD output from an HD source file.

Author:  lantz [ Fri Sep 28, 2007 4:08 pm ]
Post subject:  Re: yes and no

neutron68 wrote:
lantz wrote:
neutron68 wrote:
transcode a recorded HDTV file down to a standard definition file and burn a dvd of it right out of the box?


Well, the reason is that DVD's aren't HD themselves.

Correct. Video DVDs are SD by definition.
I simply was not aware that MythArchive had the ability to transcode HDTV down to SD. I'll test it soon!

At present, I use Roxio 8 do my HDTV to SD transcoding for DVD creation. The output SD video isn't without problems, but in my experience, it produces the best looking SD output from an HD source file.


A lot of people have HD->DVD working fine out of the box.

I had to take these steps personally:
http://www.mysettopbox.tv/phpBB2/viewto ... highlight=

Author:  neutron68 [ Sat Sep 29, 2007 4:26 pm ]
Post subject:  logs

I just re-did the experiment. The file failed to be made into a dvd again.

It looks like the DVDauthor program had a hard time with the file and quit about 43MB into multiplexing it. DVDAuthor version 0.6.13. isn't as robust as I thought.

Quote:
-snip-

++ WARN: [mplex] Stream e0: data will arrive too late sent(SCR)=6069248 required(DTS)=6061179
++ WARN: [mplex] Video e0: buf= 217372 frame=002005 sector=00014213
++ WARN: [mplex] Audio bd: buf= 16125 frame=002120 sector=00000808
++ WARN: [mplex] Stream e0: data will arrive too late sent(SCR)=6239524 required(DTS)=6232350
++ WARN: [mplex] Video e0: buf= 226671 frame=002062 sector=00014843
++ WARN: [mplex] Audio bd: buf= 15165 frame=002178 sector=00000830
++ WARN: [mplex] Stream e0: data will arrive too late sent(SCR)=6582418 required(DTS)=6582200
++ WARN: [mplex] Video e0: buf= 230786 frame=002176 sector=00016105
++ WARN: [mplex] Audio bd: buf= 14493 frame=002296 sector=00000875
++ WARN: [mplex] Stream e0: data will arrive too late sent(SCR)=6747574 required(DTS)=6745863
++ WARN: [mplex] Video e0: buf= 221852 frame=002233 sector=00016705
++ WARN: [mplex] Audio bd: buf= 16317 frame=002357 sector=00000898
STAT: VOBU 64 at 40MB, 1 PGCS
++ WARN: [mplex] Stream e0: data will arrive too late sent(SCR)=9313572 required(DTS)=9313428
++ WARN: [mplex] Video e0: buf= 229970 frame=003088 sector=00021434
++ WARN: [mplex] Audio bd: buf= 15453 frame=003247 sector=00001237
++ WARN: [mplex] Stream e0: data will arrive too late sent(SCR)=9516470 required(DTS)=9511626
++ WARN: [mplex] Video e0: buf= 229063 frame=003154 sector=00022001
++ WARN: [mplex] Audio bd: buf= 16125 frame=003317 sector=00001264
**ERROR: [mplex] Too many frame drops -exiting

INFO: Video pts = 0.196 .. 105.801
INFO: Audio[0] pts = 0.244 .. 106.420
STAT: VOBU 72 at 45MB, 1 PGCS
WARN: GOP may not be closed on cell 1 of source /myth/tmp/work/1/final.mpg of pgc 1
INFO: Generating VTS with the following video attributes:
INFO: MPEG version: mpeg2
INFO: TV standard: ntsc
INFO: Aspect ratio: 4:3
INFO: Resolution: 704x480
INFO: Audio ch 0 format: ac3/2ch, 48khz drc

STAT: fixing VOBU at 10MB (17/72, 22%)
STAT: fixing VOBU at 18MB (33/72, 44%)
STAT: fixing VOBU at 28MB (49/72, 66%)
STAT: fixing VOBU at 40MB (65/72, 88%)
STAT: fixed 72 VOBUS
INFO: dvdauthor creating table of contents
INFO: Scanning /myth/tmp/work/dvd/VIDEO_TS/VTS_01_0.IFO
INFO: Creating menu for TOC

STAT: Processing /usr/share/mythtv/mytharchive/intro/ntsc_mythlogo_intro.mpg...

INFO: Video pts = 0.500 .. 7.473
INFO: Audio[0] pts = 0.500 .. 8.212

STAT: Processing /myth/tmp/work/menu-1.mpg...
STAT: VOBU 28 at 2MB, 2 PGCS
INFO: Video pts = 0.178 .. 15.159
INFO: Audio[0] pts = 0.178 .. 30.226
INFO: Audio[32] pts = 0.178 .. 0.178
STAT: VOBU 42 at 3MB, 2 PGCS
INFO: Generating VMGM with the following video attributes:
INFO: MPEG version: mpeg2
INFO: TV standard: ntsc
INFO: Aspect ratio: 4:3
INFO: Resolution: 720x480
INFO: Audio ch 0 format: ac3/2ch, 48khz drc

STAT: fixing VOBU at 1MB (17/42, 38%)
STAT: fixing VOBU at 2MB (33/42, 76%)
STAT: fixed 42 VOBUS
Finished dvdauthor
Finished processing jobs!!!

Author:  neutron68 [ Sat Sep 29, 2007 9:37 pm ]
Post subject:  HDTV to DVD - Mytharchive bombs

I just tried a test of burning an HDTV program to DVD using MythArchive. It "terminates" during the HDTV to NTSC file conversion. My system is still at R5F1. So, I guess it doesn't work in R5F1. See the progress.log file:
Quote:
2007-09-29 19:47:05 mythburn.py (0.1.20070428-1.fixes) starting up...
2007-09-29 19:47:05 Found 1 CPUs
2007-09-29 19:47:06 Obtaining MythTV settings from MySQL database for hostname mythtv
2007-09-29 19:47:06 temppath: /myth/tmp/work
2007-09-29 19:47:06 logpath: /myth/tmp/logs
2007-09-29 19:47:06 Processing Mythburn job number 1.
2007-09-29 19:47:06 Options - mediatype = 0, doburn = 0, createiso = 0, erasedvdrw = 0
2007-09-29 19:47:06 savefilename = ''
2007-09-29 19:47:06 Looking for: /usr/share/mythtv/mytharchive/themes/Compact/theme.xml
2007-09-29 19:47:06 Loading font 0, /usr/share/mythtv/FreeSans.ttf size 19
2007-09-29 19:47:06 Loading font 1, /usr/share/mythtv/FreeSans.ttf size 15
2007-09-29 19:47:06 Loading font 2, /usr/share/mythtv/FreeSans.ttf size 13
2007-09-29 19:47:06 wantIntro: 1, wantMainMenu: 1, wantChapterMenu:0, wantDetailsPage: 0
2007-09-29 19:47:06 Final DVD Video format will be ntsc
2007-09-29 19:47:06 There are 1 files to process
2007-09-29 19:47:13 Pre-processing file '1202_20070920010000.mpg' of type 'recording'
2007-09-29 19:47:13 streaminfo.xml :-
<?xml version="1.0" ?><!DOCTYPE FILEINFO><file duration="3602" filename="/myth/tv/1202_20070920010000.mpg" type="mpegts">
<streams count="3">
<video aspectratio="1.77778" bitrate="65000000" codec="mpeg2video" ffmpegindex="0" fps="29.97" height="1080" id="49" start_time="3698.29251" streamindex="0" width="1920"/>
<audio bitrate="384000" channels="2" codec="ac3" ffmpegindex="1" id="52" language="N/A" samplerate="48000" start_time="3697.980124" streamindex="1"/>
<audio bitrate="192000" channels="2" codec="ac3" ffmpegindex="2" id="53" language="N/A" samplerate="48000" start_time="3697.988711" streamindex="2"/>
</streams>
</file>
2007-09-29 19:47:13 Seeing in the Dark
2007-09-29 19:47:13 Video resolution is 1920 by 1080
2007-09-29 19:47:13 *************************************************************
2007-09-29 19:47:13 Processing file 1202_20070920010000.mpg of type recording
2007-09-29 19:47:13 *************************************************************
2007-09-29 19:47:13 File type is 'mpegts'
2007-09-29 19:47:13 Video codec is 'mpeg2video'
2007-09-29 19:47:13 Running mythtranscode --mpeg2 to fix any errors
2007-09-29 19:55:08 File will be re-encoded using profile HQ
2007-09-29 19:55:13 streaminfo.xml :-
<?xml version="1.0" ?><!DOCTYPE FILEINFO><file duration="3601" filename="/myth/tmp/work/1/newfile.mpg" type="mpeg">
<streams count="2">
<video aspectratio="1.77778" bitrate="65000000" codec="mpeg2video" ffmpegindex="0" fps="29.97" height="1080" id="480" start_time="0.32620" streamindex="0" width="1920"/>
<audio bitrate="192000" channels="2" codec="ac3" ffmpegindex="1" id="129" language="N/A" samplerate="48000" start_time="0.32400" streamindex="1"/>
</streams>
</file>
2007-09-29 19:55:13 Preferred audio languages eng and eng
2007-09-29 19:55:13 Video id: 0x1e0, Audio1: [1] 0x81 (AC3, N/A), Audio2: [-1] - 0x-1 (N/A, N/A)
2007-09-29 19:55:13 Aspect ratio is 16:9
2007-09-29 19:55:13 Re-encoding audio and video
2007-09-29 19:55:13 Encoding profile (HQ) found
2007-09-29 19:55:13 Pass 1 - ffmpeg -v 1 -i "/myth/tmp/work/1/newfile.mpg" -r ntsc -target dvd -b 9000k -s 720x480 -acodec copy -copyts -aspect 16:9 -pass 1 -passlogfile /myth/tmp/work/pass "/myth/tmp/work/1/newfile2.mpg" -map 0:0 -map 0:1
2007-09-29 21:00:17 Pass 2 - ffmpeg -v 1 -i "/myth/tmp/work/1/newfile.mpg" -r ntsc -target dvd -b 9000k -s 720x480 -acodec copy -copyts -aspect 16:9 -pass 2 -passlogfile /myth/tmp/work/pass "/myth/tmp/work/1/newfile2.mpg" -map 0:0 -map 0:1
2007-09-29 21:00:24 ************************************************************
2007-09-29 21:00:24 ERROR: Failed while running ffmpeg (Pass 2) to re-encode video.
Command was ffmpeg -v 1 -i "/myth/tmp/work/1/newfile.mpg" -r ntsc -target dvd -b 9000k -s 720x480 -acodec copy -copyts -aspect 16:9 -pass %passno -passlogfile %passlogfile "/myth/tmp/work/1/newfile2.mpg" -map 0:0 -map 0:1
2007-09-29 21:00:24 ************************************************************
2007-09-29 21:00:24
2007-09-29 21:00:24 Terminated

Author:  lantz [ Mon Oct 01, 2007 1:30 pm ]
Post subject:  Re: logs

neutron68 wrote:
I just re-did the experiment. The file failed to be made into a dvd again.

Quote:
-snip-

**ERROR: [mplex] Too many frame drops -exiting



It's not DVDAuthor, it's mplex that's having the problems, and that's because the steams passed into have issues it can't resolve. As I said earlier, the tools used by mytharchive do a good job, but aren't perfect. Particularly since the recorded files passed in generally have a lot of problems with them.

You can try the steps I pointed to earlier that I did which have so far (fingers crossed) been very successful for me. We'll have to wait for the tools to get better (or if you have the time you can help out).

Page 1 of 1 All times are UTC - 6 hours
Powered by phpBB® Forum Software © phpBB Group
http://www.phpbb.com/