Author |
Message |
Escher0
|
Posted: Tue Jan 16, 2007 11:55 pm |
|
Joined: Thu Nov 25, 2004 11:15 pm
Posts: 75
|
I'm trying to diagnose some problem with (I think) the backend but unfortunatly, logs make my head spin. Almost every night when I go in to view recordings, the frontend hangs for a bit then finally says "no recordings available." Restarting the machine fixes it and it seems to work for about another day. I know its dying before I use it because it misses recordings. I've installed mbemon as a precaution for now but I'm trying to figure out what the root cause is. I'm running a pretty standard R5E50 (clean install, no upgrade) with two PVR250s.
I'm not really sure what I'm looking for but here are some things that stood out to me:
Lots and lots and lots of these in /var/log/messages
Code: Jan 14 18:33:29 mythtv kernel: ivtv0 warning: Error Encoder DMA Jan 14 18:33:29 mythtv kernel: ivtv0 warning: ENC: (0) DMA Error 0x0000000b 000$ Jan 14 18:33:29 mythtv kernel: ivtv0 warning: ENC: (1) DMA Error 0x0000000b 000$ Jan 14 18:33:29 mythtv kernel: ivtv0 warning: ENC: (2) DMA Error 0x0000000b 000$ Jan 14 18:33:29 mythtv kernel: ivtv0 warning: ENC: (3) DMA Error 0x0000000b 000$ Jan 14 18:33:29 mythtv kernel: ivtv0 warning: ENC: REDO DMA took too many tries. Jan 14 18:33:29 mythtv kernel: ivtv0 warning: Error Encoder DMA mythbackend.log.3 looks like a failure due to the sql server crashing immediately after a commercial flagging job or a mythfilldatabase (I think it occured right before this). Code: 2007-01-14 00:01:00.823 AFD: Opened codec 0x81ae600, id(MPEG2VIDEO) type(Video) 2007-01-14 00:01:00.824 AFD: Opened codec 0x81d48e0, id(MP2) type(Audio) 2007-01-14 00:01:01.114 Scheduled 97 items in 1.3 = 0.00 match + 1.26 place 2007-01-14 00:01:01.121 Reschedule requested for id 0. 2007-01-14 00:01:01.723 Scheduled 96 items in 0.6 = 0.00 match + 0.60 place [mpeg2video @ 0xb73104a8]ac-tex damaged at 6 10 [mpeg2video @ 0xb73104a8]Warning MVs not available 2007-01-14 00:01:12.820 JobQueue: Commercial Flagging Finished, 6 break(s) foun$ [mpeg @ 0xb73dc7f0]Parser not found for Codec Id: 94210 ! 0: start_time: 0.036 duration: 334.324 1: start_time: 2491.022 duration: 334.325 2: start_time: 0.026 duration: 334.258 stream: start_time: 0.289 duration: 31392.460 bitrate=341 kb/s 2007-01-14 00:01:12.838 AFD: Opened codec 0x8206e30, id(MPEG2VIDEO) type(Video) 2007-01-14 00:01:12.839 AFD: Opened codec 0x82074d0, id(MP2) type(Audio) QSqlQuery::exec: database not open 2007-01-14 01:45:26.127 DB Error (KickDatabase): Query was: SELECT NULL; No error type from QSqlError? Strange... QSqlQuery::prepare: database not open QSqlQuery::exec: database not open 2007-01-14 01:45:26.180 DB Error (Error in JobQueue::GetJobs(), Unable to query$ Query was: SELECT j.id, j.chanid, j.starttime, j.inserttime, j.type, j.cmds, j.flags, j.st$ No error type from QSqlError? Strange... 2007-01-14 01:45:29.393 Unable to connect to database! 2007-01-14 01:45:29.394 Driver error was [1/2002]: QMYSQL3: Unable to connect Database error was: Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2) QSqlQuery::exec: database not open QSqlQuery::exec: database not open 2007-01-14 01:45:29.448 DB Error (KickDatabase): Query was: SELECT NULL; No error type from QSqlError? Strange... QSqlQuery::prepare: database not open QSqlQuery::exec: database not open 2007-01-14 01:46:43.373 Using runtime prefix = /usr 2007-01-14 01:46:43.549 New DB connection, total: 1 2007-01-14 01:46:43.573 Connected to database 'mythconverg' at host: localhost 2007-01-14 01:46:43.613 Current Schema Version: 1160 Starting up as the master server. 2007-01-14 01:46:43.699 New DB connection, total: 2 2007-01-14 01:46:43.702 Connected to database 'mythconverg' at host: localhost 2007-01-14 01:46:43.716 New DB connection, total: 3 2007-01-14 01:46:43.717 Connected to database 'mythconverg' at host: localhost 2007-01-14 01:46:43.724 EITHelper: localtime offset -5:00:00 2007-01-14 01:46:44.044 EITHelper: localtime offset -5:00:00 2007-01-14 01:46:44.314 New DB scheduler connection 2007-01-14 01:46:44.326 Connected to database 'mythconverg' at host: localhost 2007-01-14 01:46:44.338 Main::Starting HttpServer 2007-01-14 01:46:44.377 Main::Registering HttpStatus Extension 2007-01-14 01:46:44.401 mythbackend version: 0.20.20060828-3 www.mythtv.org 2007-01-14 01:46:44.402 Enabled verbose msgs: important general 2007-01-14 01:46:44.484 AutoExpire: Found 2 recorders w/max rate of 144 MiB/min 2007-01-14 01:46:44.504 AutoExpire: Required Free Space: 3.1 GB w/freq: 10 min 2007-01-14 01:46:46.357 Reschedule requested for id -1. 2007-01-14 01:46:49.911 Scheduled 96 items in 3.6 = 3.03 match + 0.53 place 2007-01-14 01:46:49.951 Recording starts soon, AUTO-Startup assumed 2007-01-14 02:16:53.079 Using runtime prefix = /usr 2007-01-14 02:16:53.274 New DB connection, total: 1 2007-01-14 02:16:53.286 Connected to database 'mythconverg' at host: localhost 2007-01-14 02:16:53.348 Current Schema Version: 1160 Starting up as the master server. 2007-01-14 02:16:53.435 New DB connection, total: 2 2007-01-14 02:16:53.450 Connected to database 'mythconverg' at host: localhost 2007-01-14 02:16:53.467 New DB connection, total: 3 2007-01-14 02:16:53.488 Connected to database 'mythconverg' at host: localhost 2007-01-14 02:16:53.511 EITHelper: localtime offset -5:00:00 2007-01-14 02:16:53.828 EITHelper: localtime offset -5:00:00 2007-01-14 02:16:54.073 New DB scheduler connection 2007-01-14 02:16:54.083 Connected to database 'mythconverg' at host: localhost 2007-01-14 02:16:54.090 Main::Starting HttpServer 2007-01-14 02:16:54.136 Main::Registering HttpStatus Extension 2007-01-14 02:16:54.136 Main::Registering HttpStatus Extension 2007-01-14 02:16:54.160 mythbackend version: 0.20.20060828-3 www.mythtv.org 2007-01-14 02:16:54.161 Enabled verbose msgs: important general 2007-01-14 02:16:54.235 AutoExpire: Found 2 recorders w/max rate of 144 MiB/min 2007-01-14 02:16:54.246 AutoExpire: Required Free Space: 3.1 GB w/freq: 10 min 2007-01-14 02:16:56.116 Reschedule requested for id -1. 2007-01-14 02:16:59.436 Scheduled 95 items in 3.3 = 2.82 match + 0.50 place 2007-01-14 02:16:59.453 Recording starts soon, AUTO-Startup assumed 2007-01-14 02:52:57.317 Using runtime prefix = /usr 2007-01-14 02:52:57.513 New DB connection, total: 1 2007-01-14 02:52:57.532 Connected to database 'mythconverg' at host: localhost 2007-01-14 02:52:57.564 Current Schema Version: 1160 Starting up as the master server. 2007-01-14 02:52:57.641 New DB connection, total: 2 2007-01-14 02:52:57.644 Connected to database 'mythconverg' at host: localhost 2007-01-14 02:52:57.658 New DB connection, total: 3 2007-01-14 02:52:57.659 Connected to database 'mythconverg' at host: localhost 2007-01-14 02:52:57.666 EITHelper: localtime offset -5:00:00 2007-01-14 02:52:57.961 EITHelper: localtime offset -5:00:00 2007-01-14 02:52:58.239 New DB scheduler connection 2007-01-14 02:52:58.242 Connected to database 'mythconverg' at host: localhost 2007-01-14 02:52:58.247 Main::Starting HttpServer 2007-01-14 02:52:58.285 Main::Registering HttpStatus Extension 2007-01-14 02:52:58.309 mythbackend version: 0.20.20060828-3 www.mythtv.org 2007-01-14 02:52:58.310 Enabled verbose msgs: important general 2007-01-14 02:52:58.385 AutoExpire: Found 2 recorders w/max rate of 144 MiB/min 2007-01-14 02:52:58.395 AutoExpire: Required Free Space: 3.1 GB w/freq: 10 min 2007-01-14 02:53:00.266 Reschedule requested for id -1. 2007-01-14 02:53:03.663 Scheduled 95 items in 3.4 = 2.88 match + 0.52 place 2007-01-14 02:53:03.713 Recording starts soon, AUTO-Startup assumed
thats the end of the file and theres no mention of the sql server in any of the other logs.
I'm not sure where else to look or what to look for so any help would be great. Let me know if you need any more info or logs. Thanks.
|
|
Top |
|
 |
modemboy
|
Posted: Wed Jan 17, 2007 2:32 am |
|
Joined: Thu Feb 24, 2005 1:36 am
Posts: 74
|
Check that you don't have any interrupts being shared by important devices, ideally you want the video, audio, and encoders on different interrupts so they don't conflict with each other. It can cause DMA errors if they fight over interrupts.
Run:
cat /proc/interrupts
from a command line and it will list the interrupts and what is using each.
_________________ MythTV box: Opty 170, MSI K8NGM2-FID, 1.5 GB PC2700, Seagate 7200.10 400GB, Lite-On Combo drive. PVR-150, HDHomeRun. Antec Sonata, Freezer 64 Pro. Oh so quiet.
|
|
Top |
|
 |
thornsoft
|
Posted: Wed Jan 17, 2007 6:47 am |
|
Joined: Fri Nov 18, 2005 9:22 am
Posts: 777
Location:
spencerport, ny (USA)
|
Hmmm.. So I guess this would be bad?
21: 4709238 IO-APIC-level cx88[0], cx88[0], nvidia
It looks like two tuners and the video card are all sharing. It may explain my random system freezes when I'm horsing around in the front-end, or FireFox, while it's recording.
|
|
Top |
|
 |
modemboy
|
Posted: Wed Jan 17, 2007 1:55 pm |
|
Joined: Thu Feb 24, 2005 1:36 am
Posts: 74
|
Yeah that's not good. Try going into your BIOS and using the option to "Reset Configuration Data" (that's what it is usually called) and make sure "Plug and Play OS" is Yes if you have that option.
_________________ MythTV box: Opty 170, MSI K8NGM2-FID, 1.5 GB PC2700, Seagate 7200.10 400GB, Lite-On Combo drive. PVR-150, HDHomeRun. Antec Sonata, Freezer 64 Pro. Oh so quiet.
|
|
Top |
|
 |
Escher0
|
Posted: Wed Jan 17, 2007 3:15 pm |
|
Joined: Thu Nov 25, 2004 11:15 pm
Posts: 75
|
Code: CPU0 CPU1 0: 68266556 3073 IO-APIC-edge timer 1: 10 9 IO-APIC-edge i8042 7: 0 0 IO-APIC-edge parport0 8: 1 1 IO-APIC-edge rtc 12: 105 31 IO-APIC-edge i8042 14: 6008051 20 IO-APIC-edge ide0 16: 1 1 IO-APIC-level yenta 17: 457849 1 IO-APIC-level SiS SI7012, ivtv1, eth0 18: 257501 1 IO-APIC-level ohci1394, ivtv0 19: 0 0 IO-APIC-level ohci_hcd:usb2 20: 1 1 IO-APIC-level acpi, ohci_hcd:usb1 21: 0 0 IO-APIC-level ohci_hcd:usb3 22: 0 0 IO-APIC-level ehci_hcd:usb4 NMI: 0 0 LOC: 68276556 68296553 ERR: 0 MIS: 0
If I'm reading this correctly, it looks like video, a tuner, and ethernet are all sharing #17. Will reseting the config data in the bios require the capture cards to be reassigned or is it just changing DMA stuff?
|
|
Top |
|
 |
modemboy
|
Posted: Thu Jan 18, 2007 1:24 am |
|
Joined: Thu Feb 24, 2005 1:36 am
Posts: 74
|
It will only mess with DMA stuff, basically just reassigns the BIOS assigned interrupts.
You also might mess around with turning on or off APIC, which stands for Advanced Programmable Interrupt Controller, not to be confused with ACPI. APIC allows the OS to assign interrupt priority and might help.
_________________ MythTV box: Opty 170, MSI K8NGM2-FID, 1.5 GB PC2700, Seagate 7200.10 400GB, Lite-On Combo drive. PVR-150, HDHomeRun. Antec Sonata, Freezer 64 Pro. Oh so quiet.
|
|
Top |
|
 |
jmacmythtv
|
Posted: Wed Jan 24, 2007 8:07 am |
|
Joined: Sun Mar 19, 2006 10:42 am
Posts: 89
|
Thought that I would jump in here to say that I am having the same symptoms with R5D1. It was working great for several months then all of a sudden everything went wrong. I thought I had it fixed by blacklisting cx88_alsa (2xhd5500 and 2 pvr250 cards) but that only lasted a week. Rebooting keeps me up for a little while at a time now.
My cat /proc/interrupts:
CPU0
0: 44191064 IO-APIC-edge timer
1: 1157 IO-APIC-edge i8042
7: 0 IO-APIC-edge parport0
9: 0 IO-APIC-level acpi
12: 3973 IO-APIC-edge i8042
14: 109 IO-APIC-edge ide0
15: 295 IO-APIC-edge ide1
16: 655072 IO-APIC-level skge, ivtv0
17: 310443 IO-APIC-level libata
18: 73 IO-APIC-level uhci_hcd:usb1, uhci_hcd:usb2, uhci_hcd:usb3, uhci_hcd:usb4, ehci_hcd:usb5
19: 253525 IO-APIC-level VIA8237
20: 189487 IO-APIC-level ivtv1
21: 3007539 IO-APIC-level cx88[0], cx88[0], nvidia
22: 0 IO-APIC-level cx88[1], cx88[1]
NMI: 0
LOC: 44191003
ERR: 0
MIS: 0
One thing that I have noticed is that my ethernet (skge) goes up and down regularily - it appears to be on the same interrupt as ivtv. Here is an example of my kern.log:
Jan 22 13:48:02 myvcr kernel: skge eth0: Link is down.
Jan 22 13:48:03 myvcr kernel: skge eth0: Link is up at 100 Mbps, full duplex, flow control none
Jan 22 14:53:23 myvcr kernel: skge eth0: Link is down.
Jan 22 14:53:25 myvcr kernel: skge eth0: Link is up at 100 Mbps, full duplex, flow control none
Jan 22 21:20:59 myvcr kernel: ivtv0 warning: ENC: (0) DMA Error 0x0000000b
Jan 22 21:22:20 myvcr kernel: ivtv0 warning: ENC: (0) DMA Error 0x0000000b
Jan 22 21:22:25 myvcr kernel: ivtv0 warning: ENC: REG_DMAXFER 2 wait failed
Jan 22 21:22:29 myvcr kernel: ivtv0 warning: ENC: DMA still Pending while stopping capture!
Jan 22 22:55:24 myvcr kernel: skge eth0: Link is down.
Jan 22 22:55:25 myvcr kernel: skge eth0: Link is up at 100 Mbps, full duplex, flow control none
Jan 23 12:53:37 myvcr kernel: skge eth0: Link is down.
Jan 23 12:53:39 myvcr kernel: skge eth0: Link is up at 100 Mbps, full duplex, flow control none
Jan 23 13:35:42 myvcr kernel: skge eth0: Link is down.
Jan 23 13:35:44 myvcr kernel: skge eth0: Link is up at 100 Mbps, full duplex, flow control none
Jan 23 15:39:47 myvcr kernel: skge eth0: Link is down.
Jan 23 15:39:48 myvcr kernel: skge eth0: Link is up at 100 Mbps, full duplex, flow control none
Jan 23 15:49:09 myvcr kernel: skge eth0: Link is down.
Jan 23 15:49:11 myvcr kernel: skge eth0: Link is up at 100 Mbps, full duplex, flow control none
Jan 23 16:15:21 myvcr kernel: skge eth0: Link is down.
Jan 23 16:15:23 myvcr kernel: skge eth0: Link is up at 100 Mbps, full duplex, flow control none
Jan 23 16:58:50 myvcr kernel: ivtv0 warning: ENC: DMA still Pending while stopping capture!
Did the changes in the BIOS fix up your issue?
|
|
Top |
|
 |
Escher0
|
Posted: Thu Jan 25, 2007 2:06 pm |
|
Joined: Thu Nov 25, 2004 11:15 pm
Posts: 75
|
Sorry, I was away on a trip.
I went in the bios and the only 'reset' I found was to reset to factory settings, I'm not sure that's what you meant? I did that, APIC was already on, and turned on PnP OS. The assigned DMA didn't change much, here's the new one:
Code: CPU0 CPU1 0: 98569213 3150 IO-APIC-edge timer 1: 10 9 IO-APIC-edge i8042 7: 0 0 IO-APIC-edge parport0 8: 1 1 IO-APIC-edge rtc 12: 114 30 IO-APIC-edge i8042 14: 20318917 21 IO-APIC-edge ide0 16: 1 1 IO-APIC-level yenta 17: 372675 1 IO-APIC-level SiS SI7012, ivtv1, eth0 18: 0 0 IO-APIC-level ohci_hcd:usb2 19: 0 0 IO-APIC-level ohci_hcd:usb3 20: 1 1 IO-APIC-level acpi, ohci_hcd:usb1 21: 0 0 IO-APIC-level ehci_hcd:usb4 22: 165443 1 IO-APIC-level ohci1394, ivtv0 NMI: 0 0 LOC: 98583719 98590939 ERR: 0 MIS: 0
We'll have to see over the next couple days if that fixed anything.
|
|
Top |
|
 |
Escher0
|
Posted: Sun Jan 28, 2007 3:58 pm |
|
Joined: Thu Nov 25, 2004 11:15 pm
Posts: 75
|
So the problem is still happening and its now developed another issue where many times when I reboot to get it going again, the backend doesn't come up and I get the "Is the backend running? check the IP address" type message. After another reboot then it will work.
Any help would be greatly appreciated as myth is nearly unusable in this state as many recordings are getting missed or truncated. Thanks.
|
|
Top |
|
 |
thornsoft
|
Posted: Sun Jan 28, 2007 4:15 pm |
|
Joined: Fri Nov 18, 2005 9:22 am
Posts: 777
Location:
spencerport, ny (USA)
|
Escher0 wrote: So the problem is still happening and its now developed another issue where many times when I reboot to get it going again, the backend doesn't come up and I get the "Is the backend running? check the IP address" type message. After another reboot then it will work.
Any help would be greatly appreciated as myth is nearly unusable in this state as many recordings are getting missed or truncated. Thanks.
Read tjc's upgrade hints, as there is a fix for the backend not starting at reboot. Also, you may be interested in my "babysit_backend.sh" script. It's in the tips & hints section. It's a band-aid, but works. I've always had occasional backend crashes anyway, so I'm going to keep using it.
http://www.mysettopbox.tv/phpBB2/viewtopic.php?p=81265
|
|
Top |
|
 |
Escher0
|
Posted: Sun Jan 28, 2007 10:37 pm |
|
Joined: Thu Nov 25, 2004 11:15 pm
Posts: 75
|
Thanks for the pointer to tjc's post, I had missed that.
Also, I'm already running mbemon which should be doing what your babysit script does, correct?
|
|
Top |
|
 |
thornsoft
|
Posted: Sun Jan 28, 2007 11:28 pm |
|
Joined: Fri Nov 18, 2005 9:22 am
Posts: 777
Location:
spencerport, ny (USA)
|
Escher0 wrote: Also, I'm already running mbemon which should be doing what your babysit script does, correct?
Seems like it, but if your backend isn't starting, maybe not?
When you can't connect to the backend, is the process actually running? If not, then can you start it yourself with Alt+F3, and does that fix it until reboot? If so, then my script will help, and I wonder why mbemon doesn't help here.
|
|
Top |
|
 |
modemboy
|
Posted: Fri Feb 02, 2007 1:02 pm |
|
Joined: Thu Feb 24, 2005 1:36 am
Posts: 74
|
Well this is what I get for posting in here. I now have this exact same problem. See my post here:
http://mysettopbox.tv/phpBB2/viewtopic.php?t=13978
I'm pretty sure the problem is with ivtv. Arrgh! Hope someone else has some ideas to try cause I'm tapped out.
_________________ MythTV box: Opty 170, MSI K8NGM2-FID, 1.5 GB PC2700, Seagate 7200.10 400GB, Lite-On Combo drive. PVR-150, HDHomeRun. Antec Sonata, Freezer 64 Pro. Oh so quiet.
|
|
Top |
|
 |
modemboy
|
Posted: Fri Feb 02, 2007 2:48 pm |
|
Joined: Thu Feb 24, 2005 1:36 am
Posts: 74
|
Found this on the IVTV site:
http://ivtvdriver.org/index.php/DMA
Same problem, my mobo is on the list there. Someone in the bug report posted that adding AHCI to the kernel helped. Does R5E50 have AHCI tuned on?
Escher0 what mobo are you using and do you have a SATA hard drive?
_________________ MythTV box: Opty 170, MSI K8NGM2-FID, 1.5 GB PC2700, Seagate 7200.10 400GB, Lite-On Combo drive. PVR-150, HDHomeRun. Antec Sonata, Freezer 64 Pro. Oh so quiet.
|
|
Top |
|
 |
Escher0
|
Posted: Fri Feb 02, 2007 9:03 pm |
|
Joined: Thu Nov 25, 2004 11:15 pm
Posts: 75
|
Umm, whatever is in an Asus Pundit AB-P2600. I forget whats in there. I don't have SATA drives.
That does look like what we're seeing. Like the comment on heavy hard drive use, my system froze yesterday when I tried to copy a file over samba while it was recording a show or two. It had been fine for a couple days before that.
Would this error crash the system though? When my system locks up, it stops responding to a lot of things, like samba, ssh, etc. not just recordings
|
|
Top |
|
 |