Author |
Message |
grante
|
Posted: Mon Oct 29, 2007 10:02 am |
|
Joined: Mon Jun 27, 2005 4:42 pm
Posts: 321
Location:
Minneapolis, Minnesota, USA
|
mogator88 wrote: Commercial flagging shouldn't have any affect. In fact one form of transcoding, a lossless transcode, should do nothing more than remove those flagged sections.
You didn't check the "lossless transcoding" box, did you?
Nope. I'm pretty sure I didn't. Would that cause the
transcoding profile work fine when scheduled manually, but
cause jobs to not be scheduled automatically?
I scheduled a recordings this morning. Transcoding was enabled
and set to medium by defualt (as expected) in the recording
rule, but no transcoding was done when the recording finished.
When that recording finished, the job queue was empty, and the
modification timestamp on the mpg was 10:30 (which means it
hasn't been modified since the recording ended). Here's the
backend log when that recording finished:
Code: 2007-10-29 10:00:02.550 TVRec(1): Changing from None to RecordingOnly 2007-10-29 10:00:02.557 TVRec(1): HW Tuner: 1->1 2007-10-29 10:00:02.558 HDHRChan(10108605/0): device found at address 192.168.2.6 2007-10-29 10:00:02.625 Started recording: Curious George "Curious George's Rocket Ride; Curious George, Station Master": channel 1173 on cardid 1, sourceid 1 2007-10-29 10:30:00.051 TVRec(1): Changing from RecordingOnly to None 2007-10-29 10:30:00.135 Finished recording Curious George "Curious George's Rocket Ride; Curious George, Station Master": channel 1173 2007-10-29 10:30:00.182 Reschedule requested for id 0. 2007-10-29 10:30:01.559 Finished recording Curious George "Curious George's Rocket Ride; Curious George, Station Master": channel 1173 2007-10-29 10:30:02.275 Scheduled 283 items in 2.1 = 0.00 match + 2.09 place 0: start_time: 2120.744 duration: 161.630 1: start_time: 2120.734 duration: 161.603 2: start_time: 2120.740 duration: 161.591 stream: start_time: 23563.715 duration: 1796.005 bitrate=3999 kb/s 2007-10-29 10:30:02.445 AFD: Opened codec 0x8315570, id(MPEG2VIDEO) type(Video) 2007-10-29 10:30:02.447 AFD: Opened codec 0x81c20d0, id(AC3) type(Audio) 2007-10-29 10:30:02.448 AFD: Opened codec 0x82d0730, id(AC3) type(Audio) [mpeg2video @ 0xb72813a8]mb incr damaged [mpeg2video @ 0xb72813a8]00 motion_type at 1 15 [mpeg2video @ 0xb72813a8]00 motion_type at 1 16 [mpeg2video @ 0xb72813a8]ac-tex damaged at 3 17 [mpeg2video @ 0xb72813a8]ac-tex damaged at 5 18 [mpeg2video @ 0xb72813a8]invalid cbp at 4 19 [mpeg2video @ 0xb72813a8]00 motion_type at 3 20 [mpeg2video @ 0xb72813a8]slice mismatch [mpeg2video @ 0xb72813a8]00 motion_type at 1 22 [mpeg2video @ 0xb72813a8]00 motion_type at 9 23 [mpeg2video @ 0xb72813a8]ac-tex damaged at 5 24 [mpeg2video @ 0xb72813a8]00 motion_type at 1 25 [mpeg2video @ 0xb72813a8]ac-tex damaged at 3 26 [mpeg2video @ 0xb72813a8]ac-tex damaged at 3 27 [mpeg2video @ 0xb72813a8]ac-tex damaged at 3 28 [mpeg2video @ 0xb72813a8]ac-tex damaged at 3 29
Here are the entries in my settings table that contain the string "transcod": Code: MythArchiveAlwaysUseMythTranscode 1 mythfe1 SaveTranscoding 0 NULL AutoTranscodeBeforeAutoCommflag 0 NULL DefaultTranscoder 28 NULL AutoTranscode 1 NULL TranscodeCommand transcode mythtv MTDConcurrentTranscodes 1 mythtv JobAllowTranscode 1 mythtv MythArchiveAlwaysUseMythTranscode 1 mythtv UserJobDesc1 Transcode to PVR350 NULL JobQueueTranscodeCommand mythtranscode NULL mythvideo.TrustTranscodeFRDetect 1 mythtv TranscodeCommand transcode mythfe1 MTDConcurrentTranscodes 1 mythfe1 mythvideo.TrustTranscodeFRDetect 1 mythfe1
And here's the recording rule for the program: Code: recordid 409 type 1 chanid 1173 starttime 10:00:00 startdate 2007-10-29 endtime 10:30:00 enddate 2007-10-29 title Curious George subtitle Curious George's Rocket Ride; Curious George, Station Master description George sends supplies to the astronauts on the International Space Station; George wants to try being a stationmaster. category Children profile Default recpriority 0 autoexpire 1 maxepisodes 0 maxnewest 0 startoffset 0 endoffset 0 recgroup Default dupmethod 6 dupin 15 station TPTKids seriesid EP00846678 programid EP008466780014 search 0 autotranscode 1 autocommflag 0 autouserjob1 0 autouserjob2 0 autouserjob3 0 autouserjob4 0 findday 2 findtime 10:00:00 findid 733344 inactive 0 parentid 0 transcoder 28 tsdefault 1 playgroup Default prefinput 0 next_record 0000-00-00 00:00:00 last_record 2007-10-29 10:00:02 last_delete 0000-00-00 00:00:00
I'm stumped. Is there any way to tell the backend to be more
verbose in its log output so that I can figure out why it's
deciding not to schedule trancoding jobs?
_________________ Grant
|
|
Top |
|
 |
bigbro
|
Posted: Mon Oct 29, 2007 10:59 am |
|
Joined: Sat Dec 24, 2005 11:33 am
Posts: 400
Location:
Kitsap Peninsula, Wa., United States
|
I don't usually auto trascode files. However, I setup a job just to test and I can confirm the Auto Transcode function does not seem to be working for me either
I setup a quick file, told it to record, finish record the Comm Flag, then once that is done run a transcode to medium quality.
It recorded, and then Commflagged as all my recordings do. It did not however, kick off an auto transcode of the recording.
|
|
Top |
|
 |
grante
|
Posted: Mon Oct 29, 2007 12:41 pm |
|
Joined: Mon Jun 27, 2005 4:42 pm
Posts: 321
Location:
Minneapolis, Minnesota, USA
|
bigbro wrote: I don't usually auto trascode files. However, I setup a job just to test and I can confirm the Auto Transcode function does not seem to be working for me either
I setup a quick file, told it to record, finish record the Comm Flag, then once that is done run a transcode to medium quality.
It recorded, and then Commflagged as all my recordings do. It did not however, kick off an auto transcode of the recording.
Well, I guess I'm glad it's not just me. :/
Calling mythtranscode from the command line won't replace the
original file and update the seek table will it? I don't see
any options that imply it can do that.
I suppose I can set up a crontab entry that scans the database
for new recordings and queues up the transcoding jobs (I'll
have to figure out how the job queue works). Or I could use a
user-job to queue up the transcoding job.
I rather like the crontab entry idea. Once I get HD playback
working, I can set up the crontab progroam so that it waits 24
hours before queueing up the transcoding job. That way I don't
waste electrons transcoding shows that get watched and deleted
right away. It could also do the transcoding during the times
of day that I'm unlikely to be watching shows (keeping power
consumption and noise lower).
_________________ Grant
|
|
Top |
|
 |
bigbro
|
Posted: Mon Oct 29, 2007 12:55 pm |
|
Joined: Sat Dec 24, 2005 11:33 am
Posts: 400
Location:
Kitsap Peninsula, Wa., United States
|
You can for the interim, right arrow on a recorded program and there is a Job Options in there from that you can select Transcode the file, choices are autodetect, Low, Medium, Hig Quality and any user jobs.
The Autodetect, L,M,H options replace your existing file in place so all the seeks and displays work as before...
|
|
Top |
|
 |
grante
|
Posted: Mon Oct 29, 2007 1:09 pm |
|
Joined: Mon Jun 27, 2005 4:42 pm
Posts: 321
Location:
Minneapolis, Minnesota, USA
|
bigbro wrote: You can for the interim, right arrow on a recorded program and there is a Job Options in there from that you can select Transcode the file, choices are autodetect, Low, Medium, Hig Quality and any user jobs.
That's what I've been doing for a while, and it's getting a bit
tiresome. Oddly, when I was using a user-job to do transcoding
with mencoder, that _did_ work as advertised (user jobs got
scheduled automatically). The problem with that was that
mencoder lost A/V sync during ATSC drop-outs, and I never
figured out how to create a proper seek table.
I just looked at the schema for the jobqueue table, and it
looks like scheduling a job should be pretty simple, so I'll
tinker with that a little in my spare time.
_________________ Grant
|
|
Top |
|
 |
mogator88
|
Posted: Tue Oct 30, 2007 11:45 am |
|
Joined: Tue Jan 30, 2007 1:27 am
Posts: 299
|
More stupid questions. Sorry, but we gotta check.
1) jobs will only run during certain hours of the day. You set those in backend setup (Alt-s). Did you check this?
2) Only so many jobs can run at a time, also set in backend setup. How many simultaneous jobs do you allow?
3) Myth can send jobs to run on a remote machine..... and it appears you have a remote machine. Based on my xvid trials I'd avoid this at least for the moment. Are you allowing jobs to run remotely?
I really feel for you, you're having all kinds of trouble. But post back and let us know.
|
|
Top |
|
 |
grante
|
Posted: Tue Oct 30, 2007 2:06 pm |
|
Joined: Mon Jun 27, 2005 4:42 pm
Posts: 321
Location:
Minneapolis, Minnesota, USA
|
mogator88 wrote: More stupid questions. Sorry, but we gotta check.
1) jobs will only run during certain hours of the day. You set those in backend setup (Alt-s). Did you check this? Yes: Code: # mysql mythconverg -e "select * from settings;" | grep -i jobq | expand -t30 JobQueueMaxSimultaneousJobs 1 mythtv JobQueueCheckFrequency 60 mythtv JobQueueWindowStart 00:00 mythtv JobQueueWindowEnd 23:59 mythtv JobQueueCPU 0 mythtv JobQueueCommFlagCommand mythcommflag NULL JobQueueTranscodeCommand mythtranscode NULL
The window setting would only prevent jobs from running, not prevent them from being queued, correct? Jobs run fine once they're queued -- the problem is that the backend isn't queueing them. Quote: 2) Only so many jobs can run at a time, also set in backend setup. How many simultaneous jobs do you allow? 1 I have no problems queueing transcode jobs manually. I can queue up as many as I want, and then they run one at a time until they all finish. Quote: 3) Myth can send jobs to run on a remote machine..... and it appears you have a remote machine. Based on my xvid trials I'd avoid this at least for the moment. Are you allowing jobs to run remotely? I don't recall enabling anything like that -- I presume it's disabled by default? Any idea what the setting field name is? Code: # mysql mythconverg -e "select * from settings;" | grep -i remot | expand -t30 MythArchiveCopyRemoteFiles 0 mythfe1 MythArchiveCopyRemoteFiles 0 mythtv
# mysql mythconverg -e "select * from settings;" | grep -i job | expand -t30 JobsRunOnRecordHost 0 NULL UserJob1 /home/mythtv/bin/userjob1.sh %DIR%/%FILE% NULL UserJobDesc2 User Job #2 NULL UserJob2 NULL UserJobDesc3 User Job #3 NULL UserJob3 NULL UserJobDesc4 User Job #4 NULL UserJob4 NULL AutoRunUserJob1 0 NULL AutoRunUserJob2 0 NULL AutoRunUserJob3 0 NULL AutoRunUserJob4 0 NULL JobQueueMaxSimultaneousJobs 1 mythtv JobQueueCheckFrequency 60 mythtv JobQueueWindowStart 00:00 mythtv JobQueueWindowEnd 23:59 mythtv JobQueueCPU 0 mythtv JobAllowCommFlag 1 mythtv JobAllowTranscode 1 mythtv JobAllowUserJob1 1 mythtv JobAllowUserJob2 0 mythtv JobAllowUserJob3 0 mythtv JobAllowUserJob4 0 mythtv UserJobDesc1 Transcode to PVR350 NULL JobQueueCommFlagCommand mythcommflag NULL JobQueueTranscodeCommand mythtranscode NULL
[My "remote" machine is my the new box that's in-process. It was running as a liveCD FE while I did current consumption measurements on the motherboard.] Once jobs are queued, they run fine. Quote: I really feel for you, you're having all kinds of trouble. But post back and let us know.
And I certainly appreciate the effort people have made to help
me. Maybe when I get my new box done, I'll do a clean install and auto-transcoding will just magically start to work. 
_________________ Grant
|
|
Top |
|
 |
jigawho
|
Posted: Tue Oct 30, 2007 2:24 pm |
|
Joined: Thu Feb 09, 2006 7:18 pm
Posts: 112
|
I just skimmed this thread, but did you make sure you have the option in mythtv-setup called "allow transcoding jobs" checked? That held me up when I first was trying to setup transcoding. And just as a reference I have transcoding working on R5F27 (although my database came from an upgrade)
|
|
Top |
|
 |
grante
|
Posted: Tue Oct 30, 2007 4:15 pm |
|
Joined: Mon Jun 27, 2005 4:42 pm
Posts: 321
Location:
Minneapolis, Minnesota, USA
|
jigawho wrote: I just skimmed this thread, but did you make sure you have the option in mythtv-setup called "allow transcoding jobs" checked?
Yes. That's checked. You can see it in the settings above.
It's "JobAllowTranscode" and it has a value of "1".
_________________ Grant
|
|
Top |
|
 |
mogator88
|
Posted: Tue Oct 30, 2007 4:29 pm |
|
Joined: Tue Jan 30, 2007 1:27 am
Posts: 299
|
Well, that was going to be my next suggestion.... do a clean install. I did it once, its sometimes a good thing to do in these situations.
Back to the job queue. Even though all this information is in a database, I use the menus to check things and make changes.
|
|
Top |
|
 |
bigbro
|
Posted: Tue Oct 30, 2007 5:29 pm |
|
Joined: Sat Dec 24, 2005 11:33 am
Posts: 400
Location:
Kitsap Peninsula, Wa., United States
|
mogator, since I seem to have the same issue I thought I would try some of what you suggested.
I went in and checked the MBE settings. It is set to Allow transcodes, It is set to allow them between 00:00 and 23:59. It is allowed to run the jobs on any of my machines.
I reset these to something different finished out and then went back in a reset them. As the MBE sits right behind me I could hear the Hard Disk working when I exited both times. I am assuming that was a save to update the settings in the DB.
I have now set it to Autotranscode a show tonight. I'll report back later the results.
Mine was also an upgrade from R5C7 to R5F27, everything worked before.
It would not be acceptable to perform a fresh install right now. WAF would go to very low over that one, she has several series recorded over the summer she is just catching up on, and to have to recreate the Episode lists would be a major issue in a recreate database.
TIA I'll let the list know what I find.
For me it is not major as if I am putting away for the dry spells I usually clean up the cut list anyway and that means a manual queue of the transcode job which works correctly.
I have been playing with the Xvid stuff and found the item that you need to configure File placement iaw your mount points. Otherwise it places them on the local machine that you are running the job on, which queueing working properly can be any of them.
|
|
Top |
|
 |
grante
|
Posted: Tue Oct 30, 2007 7:41 pm |
|
Joined: Mon Jun 27, 2005 4:42 pm
Posts: 321
Location:
Minneapolis, Minnesota, USA
|
bigbro wrote: I have now set it to Autotranscode a show tonight. I'll report back later the results. Please do. Quote: Mine was also an upgrade from R5C7 to R5F27, Mine too. Quote: everything worked before. I never tried auto-transcoding before, so I can't say. Quote: It would not be acceptable to perform a fresh install right now. WAF would go to very low over that one, she has several series recorded over the summer she is just catching up on, and to have to recreate the Episode lists would be a major issue in a recreate database. If my new box looks like it's going to take too long, I might just perform a fresh install and see if that fixes things. It would have been a lot easier a few months ago before fresh episodes started showing up.  Quote: For me it is not major as if I am putting away for the dry spells I usually clean up the cut list anyway and that means a manual queue of the transcode job which works correctly.
Same here: if I queue the job manually, it works fine. I would
really like to get auto-transcoding working since I have to
transcode HD programs before I can watch them. Even with SD
ATSC recordings, the savings in disk space that result from
transcoding is worthwhile for me.
_________________ Grant
|
|
Top |
|
 |
bigbro
|
Posted: Tue Oct 30, 2007 10:05 pm |
|
Joined: Sat Dec 24, 2005 11:33 am
Posts: 400
Location:
Kitsap Peninsula, Wa., United States
|
Well it recorded the Show, once finished it Commercial Flagged the Show, next it was supposed to perform a lossless (Auto Detect) transcode. It never queued that Transcode Job.
So No Joy!
Grant, I don't find the SD disk space to be a major issue. I run the Default Capture such that I get a 720x480 picture and about 1gig per hour.
That is a pretty decent picture, definitely better than a VCR.
I have tried Transcoding down to a lesser bit rate (smaller file size) with the Auto Transcode features but I find the numbers I have to go to to get acceptable file size is less than satisfactory as far as picture quality on a 41" SDTV. If I Edit Cuts and remove just the commercials(Lossless) in SD TV, I am getting around a 42 min show that is about 620Meg in size.
Edit Cutlist takes about 4 min, and then manual queue and run Lossless takes under 20 minutes.
The only acceptable File size reduction I have found with acceptable quality is to go to xvid, 2hrs equals about 700Meg at the default setting and takes about 2.5 hrs to render. But then that of course has other issues like the files are now not in the Watch Recordings view. But an added advantage they are small enough I can put them on my Pocket PC Sd cards.
I attached my hardware below, the Lossless time is nearly the same on all 3 boxes. The xvid encoding is about 2 times slower on the lowest processor box my SBE#2
_________________ KnoppMyth R5.5
MBE: AMD64 3400+, K8N Neo4 Plat., 1Gig, Asus Extreme N6200, 320G pata, 2x320Gsata, 750Gsata, PVR-150 Retail w/Blaster
SBE: AMD XP2000, GA 7ZMMH, 1 Gig, XFX 256M 6200, 20 Gig, PVR-150 Retail w/Blaster
SBE: AMD Dur1800, 512M, PVR500
|
|
Top |
|
 |
mogator88
|
Posted: Wed Oct 31, 2007 8:38 am |
|
Joined: Tue Jan 30, 2007 1:27 am
Posts: 299
|
bigbro wrote: I have been playing with the Xvid stuff and found the item that you need to configure File placement iaw your mount points. Otherwise it places them on the local machine that you are running the job on, which queueing working properly can be any of them.
That was my experience, that running xvid conversion on a remote machine dumped the avi on the remote machine. I still don't have an xvid conversion that will "replace" the original recording like transcoding does, but I am close, thanks to tatuirovka.
I have source code that needs to be recompiled, its not something I want to do in the wee hours, and I'm pretty much working 7 days a week for the next 2-3 months. Are you up to doing some compiling? If so, its here:
http://www.mysettopbox.tv/phpBB2/viewto ... highlight=
Unfortunately, tatuirovka is using an earlier KM release so his binaries won't work for us.
I've been running the transcoding "successfully" however I'm not happy with the "low" image quality on my HDTV. I think it may have to do with the interlacing setting on playback, but I haven't checked that yet. And the "medium" quality has been increasing my file sizes! So long term, I think Xvid conversion really is the way to go.
|
|
Top |
|
 |
grante
|
Posted: Wed Oct 31, 2007 11:45 am |
|
Joined: Mon Jun 27, 2005 4:42 pm
Posts: 321
Location:
Minneapolis, Minnesota, USA
|
bigbro wrote: Well it recorded the Show, once finished it Commercial Flagged the Show, next it was supposed to perform a lossless (Auto Detect) transcode. It never queued that Transcode Job.
So No Joy! That's exactly what I see: the backend schedules the commflagging job but not the transcoding job. Quote: I don't find the SD disk space to be a major issue. I run the Default Capture such that I get a 720x480 picture and about 1gig per hour.
The local stations around here seem to broadcast ATSC SD at
2-3GB/hour. I don't notice any difference in picture quality
(on a 26" NTSC TV with SVideo input) after transcoding them
down to about 1.2GB/hour.
If I ever pull the trigger on an HD TV, transcoding might not
look so nice. I'm still considering the option of delayed
transcoding: if the recording sits around for more than a day
or two, then transcode it.
The last of the power-supply parts for my new box should arrive
tomorrow, but it doesn't have a case yet. The mobo tray I
ordered arrive with the I/O back-plate missing, and the vendor
(performance-pcs.com) doesn't seem to know what to do about it
(it was the only one they had in stock).
I was going to fabricate a case to co around the mobo tray, but
if they can't come up with the other half of the tray, I might
just go ahead and by a Lian-Li V300 and chop it down.
I think eventually I'm going to want a slimline DVD drive, but
that's not going in right away -- it'll probably enter service
w/o an optical drive.
_________________ Grant
|
|
Top |
|
 |