LinHES Forums
http://forum.linhes.org/

Mythfilldatabase not populating sources
http://forum.linhes.org/viewtopic.php?f=11&t=19716		 Page 1 of 1
Author:  steptow [ Sat Mar 21, 2009 8:39 am ]
Post subject:  Mythfilldatabase not populating sources
I have mythfilldatabse running using the following crontab entry as per the shepherd grabber
21 * * * * nice /usr/bin/mythfilldatabase --graboptions '--daily' > /var/log/mythtv/mythfilldatabase.log
This runs it hourly but grabs data daily. The problem is it only populates data for the first of 4 source ids. The log shows
2009-03-18 05:21:02.195 Using runtime prefix = /usr
2009-03-18 05:21:02.196 Empty LocalHostName.
2009-03-18 05:21:02.196 Using localhost value of family.homenet
2009-03-18 05:21:02.219 New DB connection, total: 1
2009-03-18 05:21:02.225 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:21:02.227 Closing DB connection named 'DBManager0'
2009-03-18 05:21:02.229 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:21:02.234 New DB connection, total: 2
2009-03-18 05:21:02.235 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:21:02.311 Updating source #1 (C0T1) with grabber tv_grab_au
2009-03-18 05:21:02.312 Found 12 channels for source 1 which use grabber
2009-03-18 05:21:02.890 Grabber has capabilities: baseline manualconfig preferredmethod
2009-03-18 05:21:03.469 Grabber prefers method: allatonce
2009-03-18 05:21:03.470 New DB connection, total: 3
2009-03-18 05:21:03.471 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:40:40.302 New DB connection, total: 4
2009-03-18 05:40:40.303 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:40:41.456 Updating icons for sourceid: 1
2009-03-18 05:40:41.509 New DB connection, total: 5
2009-03-18 05:40:41.510 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:40:41.545 New DB connection, total: 6
2009-03-18 05:40:41.546 Connected to database 'mythconverg' at host: family.homenet
2009-03-18 05:41:05.454 Updated programs: 759 Unchanged programs: 2537
2009-03-18 05:41:05.681 Updating source #2 (C1T1) with grabber tv_grab_au
2009-03-18 05:41:06.132 Found 6 channels for source 2 which use grabber
2009-03-18 05:41:06.861 Grabber has capabilities: baseline manualconfig preferredmethod
2009-03-18 05:41:07.457 Grabber prefers method: allatonce
2009-03-18 05:41:18.531 Error in 1:1: unexpected end of file
2009-03-18 05:41:18.531 Updating icons for sourceid: 2
2009-03-18 05:41:18.532 No programs found in data.
2009-03-18 05:41:18.534 Updating source #3 (C2T1) with grabber tv_grab_au
2009-03-18 05:41:18.534 Found 6 channels for source 3 which use grabber
2009-03-18 05:41:19.123 Grabber has capabilities: baseline manualconfig preferredmethod
2009-03-18 05:41:19.708 Grabber prefers method: allatonce
2009-03-18 05:41:30.491 Error in 1:1: unexpected end of file
2009-03-18 05:41:30.491 Updating icons for sourceid: 3
2009-03-18 05:41:30.492 No programs found in data.
2009-03-18 05:41:30.493 Updating source #4 (Digital) with grabber tv_grab_au
2009-03-18 05:41:30.494 Found 12 channels for source 4 which use grabber
2009-03-18 05:41:31.088 Grabber has capabilities: baseline manualconfig preferredmethod
2009-03-18 05:41:31.678 Grabber prefers method: allatonce
2009-03-18 05:41:42.473 Error in 1:1: unexpected end of file
2009-03-18 05:41:42.473 Updating icons for sourceid: 4
2009-03-18 05:41:42.474 No programs found in data.
2009-03-18 05:41:54.527 Data fetching complete.
2009-03-18 05:41:54.528 Adjusting program database end times.
2009-03-18 05:41:54.638 0 replacements made
2009-03-18 05:41:54.638 Marking generic episodes.
2009-03-18 05:41:54.812 Found 75
2009-03-18 05:41:54.813 Marking repeats.
2009-03-18 05:41:54.982 Found 0
2009-03-18 05:41:54.982 Unmarking new episode rebroadcast repeats.
2009-03-18 05:41:55.013 Found 0
2009-03-18 05:41:55.298 Marking episode first showings.
2009-03-18 05:41:58.971 Found 2827
2009-03-18 05:41:58.971 Marking episode last showings.
2009-03-18 05:42:03.638 Found 2827
2009-03-18 05:42:03.643
===============================================================
| Attempting to contact the master backend for rescheduling. |
| If the master is not running, rescheduling will happen when |
| the master backend is restarted. |
===============================================================
2009-03-18 05:42:03.650 Connecting to backend server: 192.168.1.4:6543 (try 1 of 5)
2009-03-18 05:42:03.651 Using protocol version 40
2009-03-18 05:42:04.754 Received a remote 'Clear Cache' request
2009-03-18 05:42:04.757 mythfilldatabase run complete.
2009-03-18 05:42:04.757 DataDirect: Deleting temporary files

The error appears to be Error in 1:1: unexpected end of file.

If I run mythfilldatabase using the command nohup mythfilldatabase --graboptions '--notimetest' > mythfilldatabase1.log &
listings are populated for all 4 source ids. Not that this invokes the grabber once for each source ie. 4 times

Any ideas on how to make the regular mythfilldatabase (with shepherd) job populate program data for all 4 sources

Thanks
Author:  steptow [ Wed Apr 15, 2009 7:38 am ]
Post subject: 
To progress this I have made cron run the following
21 * * * * nice /home/mythtv/myfill > /var/log/mythtv/mythfilldatabase.log

The content of myfill is
#
# First get listings using shepherd grabber into a file
output_xmltv=/home/mythtv/output.xmltv
echo $output_xmltv
ls -l $output_xmltv

tv_grab_au --daily --output $output_xmltv
#
# Test the output for new data
# If it is zero length then don't run mythfilldatabase

if [ -s $output_xmltv ]; then
echo NON_EMPTY;
# Then run mythfilldatabase once for each source using the file
mythfilldatabase --update --file 1 $output_xmltv
mythfilldatabase --update --file 2 $output_xmltv
mythfilldatabase --update --file 3 $output_xmltv
mythfilldatabase --file 4 $output_xmltv
mv $output_xmltv /home/mythtv/last_output.xmltv
else
echo EMPTY;
fi

What this does is run the grabber once and then uses the file to populate each of the sources. The problem with mythfilldatabase and shepherd is that mythfilldatabase runs the grabber once for each source but the shepherd grabber with the daily option will only run once per day and therefore the sources 2-4 were getting an empty grabber output. Hope this helps someone else
Author:  nmcaullay [ Wed Apr 15, 2009 7:44 pm ]
Post subject: 
Hi there,

Not sure if you have seen this, i guess you might have, but thought i'd post it anyway.

The following link describes how to get shepherd to work with mythfilldatabase for multiple sources (which sounds like your requirement?).

http://svn.whuffy.com/index.cgi/wiki/Installation

Code:
44 * * * * tv_grab_au --daily --quiet && mythfilldatabase --update --file 1 ~/.shepherd/output.xmltv --quiet && mythfilldatabase --update --file 2 ~/.shepherd/output.xmltv --quiet


Basically, the following occurs
1) tv_grab_au runs (which is a symlink to shepherd), and creates the output.xmltv file (only actually scrapes once a day with the --daily flag)
2) mythfilldatabase runs for source 1
3) mythfilldatabase runs for source 2

Also, i'd check that you have set the following also (from the link above)
Code:
[MythTV users only] Install and configure MythTV first. In mythtv-setup -> 3. Video Sources -> (your video source) -> Listings grabber, select No grabber. Perform a channel scan: mythtv-setup -> 5. Channel Editor -> Channel Scanner.


Again, apologies if i'm telling you how to suck eggs, but it seems on the surface that this would be what you are trying to achieve?

Cheers,

Nathan
Author:  steptow [ Thu Apr 16, 2009 7:18 am ]
Post subject: 
Thanks. Yes I missed the detail of that. My file myfill looks like it is doing the same as the crontab entry. I am a script person rather than multiple commands on a single line which explains the difference..

Brian
Page 1 of 1 All times are UTC - 6 hours
Powered by phpBB® Forum Software © phpBB Group
http://www.phpbb.com/