Author |
Message |
Escher0
|
Posted: Fri Nov 24, 2006 8:50 pm |
|
Joined: Thu Nov 25, 2004 11:15 pm
Posts: 75
|
My myth box is having several problems but before I start messing with stuff, I wanted to do a backup but unfortunatly thats not working either. When I run mythbackup, it gets all the way through and fails on the verification steps. I'm running r5d1 so this is the new backup script of course.
Code: Sanity checking your backup...
Checking the integrity of the compressed backup file... Compression looks OK. Generating a list of the backup contents... Generating a list of the directory contents... Comparing directory versus backup contents... 3432a3433 > ./home/mythtv/.aptitude/.tmp/aptitudeLxUoNd 3433a3435 > ./home/mythtv/.aptitude/.tmp/aptitudePV0mgd Warning, file lists are not identical!
Checking DB dump Generating a list of tables and record counts in the DB dump... Generating a list of tables and record counts in the live DB... Comparing live versus saved tables... Live and saved table lists match.
The backup is bad or already out of date!
The other problems are varied and I think may be because I did an upgrade to ressurect a crashed system. The big ones are that randomly during playback, the video will jump like it missed a few frames or something but the sound continues normally which makes the sound off from the video. Saving the position and exiting and reentering the video gets it back on sync.
The other is that at seemingly random times on menu changes the frontend will either quit or freeze. Restarting the frontend sometimes fixes this but usually ends up with it just freezing again soon. I've setup mbemon so I'll have to see if that helps some.
I really have no idea what the problem is or where to start. My first hunch is that it may be hard drive or ram problems but I'm not entirely sure how to check them and I'm not entirely comfortable doing trial and error without a valid backup. I flagged to do a fsck on statup but because of the startup progress bar screen, I couldn't see the results and am not sure where a log of that would be if any.
Any help on any of these would be greatly appreciated, thanks.
|
|
Top |
|
 |
marc.aronson
|
Posted: Sat Nov 25, 2006 1:24 pm |
|
Joined: Tue Jan 18, 2005 2:07 am
Posts: 1532
Location:
California
|
Here's my feedback:
1. The warning you are getting from the backup script probably means that there is some other process running while the backup is running, and that other process is fiddeling with the files in the directory identified. I don't have a /home/mythtv/.aptitude directory, so I don't know what it's about, but the path names implies it is a temporary directory so it probably doesn't matter.
2. mbemon won't solve problems that are persistant, frequent and unrelated to failures of the backend process. mbemon probably will not help you with this problem.
3. I suggest you check various log files include the front-end log file, system log files, etc. There is an article in the wiki that explains the various log files. http://www.knoppmythwiki.org/index.php? ... ngLogFiles
4. Check to make sure your database doesn't have broken tables -- read the sticky here http://mysettopbox.tv/phpBB2/viewtopic.php?t=1043
Marc
|
|
Top |
|
 |
Escher0
|
Posted: Sat Nov 25, 2006 2:37 pm |
|
Joined: Thu Nov 25, 2004 11:15 pm
Posts: 75
|
Thanks for the reply.
1) I was hoping that it was just a garbage folder but I wasn't sure. So the backup should be fine then except for that one folder?
2) I had assumed, possibly incorrectly, that the frontend problems were associated with backend crashes as it usually did not restore it even with relaunching the frontend.
3) I found a couple things in the logs that may be related.
In /var/log/mythtv/mythbackend.log
a bunch of these:
Code: 2006-11-22 21:09:28.670 AFD Error: Unknown decoding error [mpeg2video @ 0xb70ad620]get_buffer() failed (stride changed) 2006-11-22 21:09:28.672 AFD Error: Unknown decoding error [mpeg2video @ 0xb70ad620]get_buffer() failed (stride changed) 2006-11-22 21:09:28.675 AFD Error: Unknown decoding error [mpeg2video @ 0xb70ad620]releasing zombie picture
and these: Code: 2006-11-22 22:09:00.426 AFD: Opened codec 0x80f3a40, id(MPEG2VIDEO) type(Video) 2006-11-22 22:09:00.460 AFD: Opened codec 0x80f4220, id(MP2) type(Audio) [mpeg2video @ 0xb7019620]ac-tex damaged at 19 15 [mpeg2video @ 0xb7019620]Warning MVs not available [mpeg2video @ 0xb7019620]00 motion_type at 20 29 [mpeg2video @ 0xb7019620]00 motion_type at 21 11 [mpeg2video @ 0xb7019620]Warning MVs not available [mpeg2video @ 0xb7019620]end mismatch left=1122 [mpeg2video @ 0xb7019620]ac-tex damaged at 2 28 [mpeg2video @ 0xb7019620]00 motion_type at 18 29 [mpeg2video @ 0xb7019620]00 motion_type at 20 29 [mpeg2video @ 0xb7019620]ac-tex damaged at 10 22 [mpeg2video @ 0xb7019620]skipped MB in I frame at 27 29
etc...
Nothing else jumped out at me as being related.
4) Ran through that and found no broken tables.
Thanks again for your help.
|
|
Top |
|
 |
tjc
|
Posted: Thu Nov 30, 2006 8:35 pm |
|
Joined: Thu Mar 25, 2004 11:00 am
Posts: 9551
Location:
Arlington, MA
|
That backup error should be harmless. Looks like you were running aptitude in another window or something.
In general you should be running the backup on an idle system. It shuts down the DB and the backend server as necessary, but since it runs from the frontend menus we can't knock the system down to single user mode. As a result we have to leave it up to the user not to do other stuff on the system that could interfer.
|
|
Top |
|
 |
marc.aronson
|
Posted: Thu Nov 30, 2006 8:41 pm |
|
Joined: Tue Jan 18, 2005 2:07 am
Posts: 1532
Location:
California
|
|
Top |
|
 |
Escher0
|
Posted: Thu Nov 30, 2006 8:50 pm |
|
Joined: Thu Nov 25, 2004 11:15 pm
Posts: 75
|
So Tuesday this machine actually completely died and the backend refuses to startup even after an attempt to re-upgrade. Because of all the problems it's been having I don't think its worth all the effort to fix it and I'll just nuke the whole system and start over.
On that note, here's a question. I'm thinking of pulling out the existing recordings out of the pretty folder (either using samba or burning to dvd) then later restoring them to the video folder so as not to completely lose them but is there a set of instructions on how to back up the original .nuv's and reinsert them into a brand new database to maintain the show information?
|
|
Top |
|
 |
tjc
|
Posted: Thu Nov 30, 2006 11:05 pm |
|
Joined: Thu Mar 25, 2004 11:00 am
Posts: 9551
Location:
Arlington, MA
|
You can do this with nuvexport but it was a one by one operation last time I played with it.
You can also do a DB backup and extract the information from that. The dump format used is executable SQL statements which reinsert the records into the DB. All you need to do is filter out the commands for the tables that you need and feed that into mysql. There is some discussion of this in the "how to take advantage of the new backup and restore" sticky thread under the "Hints & Tips" topic.
|
|
Top |
|
 |
crushinator
|
Posted: Sun Apr 22, 2007 2:48 am |
|
Joined: Sun Jan 22, 2006 12:37 am
Posts: 30
Location:
Cleveland, OH
|
tjc wrote: That backup error should be harmless. My backup before upgrading from R5B7 to R5E50 also " backup failed" but the upgrade worked. It was scary though. It failed on the verification step of backup as well. I would feel better if I could get the voice " backup verified." tjc wrote: In general you should be running the backup on an idle system. It shuts down the DB and the backend server as necessary, but since it runs from the frontend menus we can't knock the system down to single user mode. As a result we have to leave it up to the user not to do other stuff on the system that could interfer.
How do I do these?
1. Run backup on an idle system:
okay, so I run the backup at a time when there is no recording, no commercial detection jobs, no transcoding jobs, no mythfilldatabase.
2. Run from single user mode
okay, so I could exit the mythfrontend, then run "mythbackup" from commandline. I assume it will automatically stop mythbackend and mysql as necessary. Do I run as root or as mythtv user? How do I "knock down to single user mode?"
|
|
Top |
|
 |
tjc
|
Posted: Sun Apr 22, 2007 8:30 am |
|
Joined: Thu Mar 25, 2004 11:00 am
Posts: 9551
Location:
Arlington, MA
|
crushinator wrote: How do I do these?
1. Run backup on an idle system: okay, so I run the backup at a time when there is no recording, no commercial detection jobs, no transcoding jobs, no mythfilldatabase.
2. Run from single user mode okay, so I could exit the mythfrontend, then run "mythbackup" from commandline. I assume it will automatically stop mythbackend and mysql as necessary. Do I run as root or as mythtv user? How do I "knock down to single user mode?"
The backup should be run as root, the FE GUI does this using "sudo". You can go to single user mode using the following command from a console as root:
Code: telInit 1
You should also be sure to stop any mbemon, or other magic restart processes before attempting the backup.
I generally just run the backup from an ssh session and don't have any problems. YMMV if you've got a bunch of add-on daemon processes or cron jobs or a multiple BE/FE setup with multiple users.
As always, reporting the exact errors you're seeing would let us tell you more about what you're doing wrong...
|
|
Top |
|
 |
cmshawn2
|
Posted: Sat Sep 01, 2007 12:00 am |
|
Joined: Mon Nov 27, 2006 12:43 am
Posts: 12
|
I am also running mythbackup from an ssh session. I don't know what mbemon is, but I made sure that I didn't have any restart cron jobs running (I used to have a home-grown one, but I think that was before I switched to KM). A ps aux for mbemon doesn't find anything.
I stopped the Myth backend before embarking on the upgrade process, but I'm finding that it has started up again after mythbackup has been run. This is the verification output I get at the end of mythbackup:
Code: Checking the integrity of the compressed backup file... Compression looks OK. Generating a list of the backup contents... Generating a list of the directory contents... Comparing directory versus backup contents... Live and saved file lists match.
Checking DB dump Generating a list of tables and record counts in the DB dump... Generating a list of tables and record counts in the live DB... Comparing live versus saved tables... 17,18c17,18 < inuseprograms 4 < jobqueue 2 --- > inuseprograms 3 > jobqueue 1 31c31 < oldrecorded 1182 --- > oldrecorded 1181 45c45 < recordedmarkup 516776 --- > recordedmarkup 512550 Warning, table lists are not identical!
If I run checkbackup immediately after this, I get Code: Checking the integrity of the compressed backup file... Compression looks OK. Generating a list of the backup contents...
And then I'm returned to the prompt.
My suspicion is that I can continue with the upgrade in relative safety, since I don't really care if I've missed a recording. Or do you (meaning the community at large) think this could create problems? (This is my first upgrade ever of KM.) I'm running R5D1 right now, and am anxious to get upgraded so I can switch to the new Schedules Direct feed. (I was going to upgrade this summer, but decided instead to wait until the listings issue had been addressed.)
BTW, what are "inuseprograms" in my first quote above?
|
|
Top |
|
 |
tjc
|
Posted: Sat Sep 01, 2007 10:53 am |
|
Joined: Thu Mar 25, 2004 11:00 am
Posts: 9551
Location:
Arlington, MA
|
It looks kind of like you've got several front ends running, or commflag or transcode jobs. I'd do a quick check for this (it may pay to disconnect the network if you've got remote FEs) and rerun the backup. If you want to discard the previous one you can use the rollback.sh script.
Also, there's no need to manually shut down the BE or the database, since the backup script takes care of that itself, along with restarting them when it's done. The big concern is having some kind of outside piece restarting the BE or fooling with the DB in mid process. I would have the script automatically shut down the FE too to help avoid this, but it could be the parent process of backup script, or the FE could be remote, or ...
|
|
Top |
|
 |
cmshawn2
|
Posted: Mon Sep 03, 2007 1:32 am |
|
Joined: Mon Nov 27, 2006 12:43 am
Posts: 12
|
Before starting the upgrade process I had shut down the FE (I'm only using the one machine for Myth), then the Back End before doing a full backup of the entire system. Then I ran mythbackup (with both still shut down).
I'll try letting mythbackup shut down the BE on its own (the FE is still shut down) when I get the next window of no activity (about 36 hours from now). As I said, there are no cron jobs (other than what KM sets up), so I'm not seeing anything that looks to me like it would be altering the database.
Re: rollback.sh, I've just been deleting the contents of /myth/backup before starting running mythbackup again. Am I missing something else that rollback.sh does?
|
|
Top |
|
 |
tjc
|
Posted: Mon Sep 03, 2007 7:30 am |
|
Joined: Thu Mar 25, 2004 11:00 am
Posts: 9551
Location:
Arlington, MA
|
You really shouldn't need to do all those things. The only reason i suggested knocking out the FEs is in cased you had a number of other FE boxes with other people using them. The scripts generally take care of this themselves.
You also shouldn't need to delete the contents of the /myth/backup directory. The modern backup scripts normally keep a roll over stack of up to ten old numbered backups. The rollback.sh script just pops the head of that stack which lets you discard a bad one without creating gaps in the numbering.
Given the differences with the jobqueue and inuseprograms my guess would be that you have commercial marking or transcoding jobs running at the time. If you haven't retried the backup at an idle time I would strongly recommend it.
|
|
Top |
|
 |
cmshawn2
|
Posted: Mon Sep 03, 2007 2:04 pm |
|
Joined: Mon Nov 27, 2006 12:43 am
Posts: 12
|
Was finally able to get a good backup. Thanks for all the help 
|
|
Top |
|
 |