View unanswered posts    View active topics

All times are UTC - 6 hours





Post new topic Reply to topic  [ 4 posts ] 
Print view Previous topic   Next topic  
Author Message
Search for:
PostPosted: Sat Mar 21, 2009 8:39 am 
Offline
Joined: Mon Oct 24, 2005 8:37 am
Posts: 27
I have mythfilldatabse running using the following crontab entry as per the shepherd grabber
21 * * * * nice /usr/bin/mythfilldatabase --graboptions '--daily' > /var/log/mythtv/mythfilldatabase.log
This runs it hourly but grabs data daily. The problem is it only populates data for the first of 4 source ids. The log shows
2009-03-18 05:21:02.195 Using runtime prefix = /usr
2009-03-18 05:21:02.196 Empty LocalHostName.
2009-03-18 05:21:02.196 Using localhost value of family.homenet
2009-03-18 05:21:02.219 New DB connection, total: 1
2009-03-18 05:21:02.225 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:21:02.227 Closing DB connection named 'DBManager0'
2009-03-18 05:21:02.229 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:21:02.234 New DB connection, total: 2
2009-03-18 05:21:02.235 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:21:02.311 Updating source #1 (C0T1) with grabber tv_grab_au
2009-03-18 05:21:02.312 Found 12 channels for source 1 which use grabber
2009-03-18 05:21:02.890 Grabber has capabilities: baseline manualconfig preferredmethod
2009-03-18 05:21:03.469 Grabber prefers method: allatonce
2009-03-18 05:21:03.470 New DB connection, total: 3
2009-03-18 05:21:03.471 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:40:40.302 New DB connection, total: 4
2009-03-18 05:40:40.303 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:40:41.456 Updating icons for sourceid: 1
2009-03-18 05:40:41.509 New DB connection, total: 5
2009-03-18 05:40:41.510 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:40:41.545 New DB connection, total: 6
2009-03-18 05:40:41.546 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:41:05.454 Updated programs: 759 Unchanged programs: 2537
2009-03-18 05:41:05.681 Updating source #2 (C1T1) with grabber tv_grab_au
2009-03-18 05:41:06.132 Found 6 channels for source 2 which use grabber
2009-03-18 05:41:06.861 Grabber has capabilities: baseline manualconfig preferredmethod
2009-03-18 05:41:07.457 Grabber prefers method: allatonce
2009-03-18 05:41:18.531 Error in 1:1: unexpected end of file
2009-03-18 05:41:18.531 Updating icons for sourceid: 2
2009-03-18 05:41:18.532 No programs found in data.
2009-03-18 05:41:18.534 Updating source #3 (C2T1) with grabber tv_grab_au
2009-03-18 05:41:18.534 Found 6 channels for source 3 which use grabber
2009-03-18 05:41:19.123 Grabber has capabilities: baseline manualconfig preferredmethod
2009-03-18 05:41:19.708 Grabber prefers method: allatonce
2009-03-18 05:41:30.491 Error in 1:1: unexpected end of file
2009-03-18 05:41:30.491 Updating icons for sourceid: 3
2009-03-18 05:41:30.492 No programs found in data.
2009-03-18 05:41:30.493 Updating source #4 (Digital) with grabber tv_grab_au
2009-03-18 05:41:30.494 Found 12 channels for source 4 which use grabber
2009-03-18 05:41:31.088 Grabber has capabilities: baseline manualconfig preferredmethod
2009-03-18 05:41:31.678 Grabber prefers method: allatonce
2009-03-18 05:41:42.473 Error in 1:1: unexpected end of file
2009-03-18 05:41:42.473 Updating icons for sourceid: 4
2009-03-18 05:41:42.474 No programs found in data.
2009-03-18 05:41:54.527 Data fetching complete.
2009-03-18 05:41:54.528 Adjusting program database end times.
2009-03-18 05:41:54.638 0 replacements made
2009-03-18 05:41:54.638 Marking generic episodes.
2009-03-18 05:41:54.812 Found 75
2009-03-18 05:41:54.813 Marking repeats.
2009-03-18 05:41:54.982 Found 0
2009-03-18 05:41:54.982 Unmarking new episode rebroadcast repeats.
2009-03-18 05:41:55.013 Found 0
2009-03-18 05:41:55.298 Marking episode first showings.
2009-03-18 05:41:58.971 Found 2827
2009-03-18 05:41:58.971 Marking episode last showings.
2009-03-18 05:42:03.638 Found 2827
2009-03-18 05:42:03.643
===============================================================
| Attempting to contact the master backend for rescheduling. |
| If the master is not running, rescheduling will happen when |
| the master backend is restarted. |
===============================================================
2009-03-18 05:42:03.650 Connecting to backend server: 192.168.1.4:6543 (try 1 of 5)
2009-03-18 05:42:03.651 Using protocol version 40
2009-03-18 05:42:04.754 Received a remote 'Clear Cache' request
2009-03-18 05:42:04.757 mythfilldatabase run complete.
2009-03-18 05:42:04.757 DataDirect: Deleting temporary files

The error appears to be Error in 1:1: unexpected end of file.

If I run mythfilldatabase using the command nohup mythfilldatabase --graboptions '--notimetest' > mythfilldatabase1.log &
listings are populated for all 4 source ids. Not that this invokes the grabber once for each source ie. 4 times

Any ideas on how to make the regular mythfilldatabase (with shepherd) job populate program data for all 4 sources

Thanks

_________________
Hardware
AMD Sempron
Gigabyte 2004RZ
ATI Radeon 9250
Hauppage PVR-150 (x2)
Leadtek DTV2000H
Software
R5A16 upgraded to R5C7 upgraded to R5E50 now R5.5


Top
 Profile  
 
 Post subject:
PostPosted: Wed Apr 15, 2009 7:38 am 
Offline
Joined: Mon Oct 24, 2005 8:37 am
Posts: 27
To progress this I have made cron run the following
21 * * * * nice /home/mythtv/myfill > /var/log/mythtv/mythfilldatabase.log

The content of myfill is
#
# First get listings using shepherd grabber into a file
output_xmltv=/home/mythtv/output.xmltv
echo $output_xmltv
ls -l $output_xmltv

tv_grab_au --daily --output $output_xmltv
#
# Test the output for new data
# If it is zero length then don't run mythfilldatabase

if [ -s $output_xmltv ]; then
echo NON_EMPTY;
# Then run mythfilldatabase once for each source using the file
mythfilldatabase --update --file 1 $output_xmltv
mythfilldatabase --update --file 2 $output_xmltv
mythfilldatabase --update --file 3 $output_xmltv
mythfilldatabase --file 4 $output_xmltv
mv $output_xmltv /home/mythtv/last_output.xmltv
else
echo EMPTY;
fi

What this does is run the grabber once and then uses the file to populate each of the sources. The problem with mythfilldatabase and shepherd is that mythfilldatabase runs the grabber once for each source but the shepherd grabber with the daily option will only run once per day and therefore the sources 2-4 were getting an empty grabber output. Hope this helps someone else

_________________
Hardware
AMD Sempron
Gigabyte 2004RZ
ATI Radeon 9250
Hauppage PVR-150 (x2)
Leadtek DTV2000H
Software
R5A16 upgraded to R5C7 upgraded to R5E50 now R5.5


Top
 Profile  
 
 Post subject:
PostPosted: Wed Apr 15, 2009 7:44 pm 
Offline
Joined: Sun Sep 04, 2005 7:48 pm
Posts: 264
Location: Perth, Australia
Hi there,

Not sure if you have seen this, i guess you might have, but thought i'd post it anyway.

The following link describes how to get shepherd to work with mythfilldatabase for multiple sources (which sounds like your requirement?).

http://svn.whuffy.com/index.cgi/wiki/Installation

Code:
44 * * * * tv_grab_au --daily --quiet && mythfilldatabase --update --file 1 ~/.shepherd/output.xmltv --quiet && mythfilldatabase --update --file 2 ~/.shepherd/output.xmltv --quiet


Basically, the following occurs
1) tv_grab_au runs (which is a symlink to shepherd), and creates the output.xmltv file (only actually scrapes once a day with the --daily flag)
2) mythfilldatabase runs for source 1
3) mythfilldatabase runs for source 2

Also, i'd check that you have set the following also (from the link above)
Code:
[MythTV users only] Install and configure MythTV first. In mythtv-setup -> 3. Video Sources -> (your video source) -> Listings grabber, select No grabber. Perform a channel scan: mythtv-setup -> 5. Channel Editor -> Channel Scanner.


Again, apologies if i'm telling you how to suck eggs, but it seems on the surface that this would be what you are trying to achieve?

Cheers,

Nathan

_________________
LinHES: R6 | MB: Asus M3N-H/HDMI | CPU: AMD ??Mhz
Capture: 2xHDHR DVB-T
Graphics: Onboard 8300|PSU: Corsair vx450w
Cooling: Zalman cu?,
Display: Benq xx projector


Top
 Profile  
 
 Post subject:
PostPosted: Thu Apr 16, 2009 7:18 am 
Offline
Joined: Mon Oct 24, 2005 8:37 am
Posts: 27
Thanks. Yes I missed the detail of that. My file myfill looks like it is doing the same as the crontab entry. I am a script person rather than multiple commands on a single line which explains the difference..

Brian

_________________
Hardware
AMD Sempron
Gigabyte 2004RZ
ATI Radeon 9250
Hauppage PVR-150 (x2)
Leadtek DTV2000H
Software
R5A16 upgraded to R5C7 upgraded to R5E50 now R5.5


Top
 Profile  
 

Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 4 posts ] 


All times are UTC - 6 hours




Who is online

Users browsing this forum: No registered users and 18 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
cron
Powered by phpBB® Forum Software © phpBB Group

Theme Created By ceyhansuyu