Board Logo

crashing while updating library
jojo - 5-15-2007 at 03:31 AM

Audiosoft, not sure what's up, looking into it more, I'm in the process of moving my files. When I'm in the middle of updating the library EJ crashes all the way out to no longer running.


Audiosoft - 5-15-2007 at 03:54 AM

If it crashes again: open up C:Program FileseJukeboxdb.m3u in notepad and check the last 2 files listed. Make sure they are not corrupt or incomplete file downloads.


jojo - 5-15-2007 at 06:50 AM

Quote:
Originally posted by Audiosoft
If it crashes again: open up C:Program FileseJukeboxdb.m3u in notepad and check the last 2 files listed. Make sure they are not corrupt or incomplete file downloads.


Well, I thought I was onto it, in the db.m3u file the last track was a partial path, I moved that one folder to try and fix it, it crashed again, then I attempted to rebuild the libray and it crashed on a different folder, one that it passed before. looks like a bug


Audiosoft - 5-15-2007 at 07:00 AM

i doubt it is a bug because I just rebuilt a database with 9000 songs using v4.61 and had no problems.

what happens? does ejukebox just disappear? do you get an error message? if it is a problem with a particular files it would be the file that comes after the last line in db.m3u.


Pirk - 5-15-2007 at 04:47 PM

Well.. for my part, I've tried to rebuild 2 folders with eJ 4.61 after I removed some unwanted "asn" tags using an external editor (Godfather).
The first folder (547 albums in it) reloaded good, very slowly but good! The second one is a big one: more than 25000 files in it: It started to reload slowly until +/- 6500 files.. but I was obliged to close the eJukebox rebuild box, because my PC was almost 100% paralysed by this process (only the mouse is not paralysed). I think the problem is the RAM memory of my PC (1024 Mo) becomes completely saturated during the loading of song datas (some songs, the first song of each album in particular, are very long to load - all my "old" albums include id3 images.. It seems the image loading process is very slow), while the processor is not used a lot! So during the database rebuild my PC is totally unusable, and the update is so slow than I can't reload a big folder until the end: 24H was insufficient! For the big folder, it only loaded 7000 files during a day..

Audiosoft, I don't know if my PC is in question or eJukebox??

Thanks.


jojo - 5-15-2007 at 04:50 PM

Quote:
Originally posted by Audiosoft
i doubt it is a bug because I just rebuilt a database with 9000 songs using v4.61 and had no problems.

what happens? does ejukebox just disappear? do you get an error message? if it is a problem with a particular files it would be the file that comes after the last line in db.m3u.


It just disappears, I've not seen a message. Well, I do have some developments, I restored my library from backup, so it should be the perfectly working library that it was. Now it's only seeing about 1500 of the 7,000 tracks in the folders.

Could it be paths too long? I'm trying to move the library so the path names aren't too long for other programs.

Currently: C:documents and settingsjojoMy DocumentsMy Music%artist%albumtrack#-artist-title

moving to: C:MediaMusic%artist%albumtrack#-artist-title


Some of those tracks for some reason are much deeper file structure (a problem I'm looking into) something like :

Currently: C:documents and settingsjojoMy DocumentsMy Music%artist%album%artist%albumtrack#-tittle-artist-album.xxx

Not sure why or what changed them to the worse structure, but will fix today.


jojo - 5-15-2007 at 10:13 PM

Quote:
Originally posted by Pirk
Well.. for my part, I've tried to rebuild 2 folders with eJ 4.61 after I removed some unwanted "asn" tags using an external editor (Godfather).
The first folder (547 albums in it) reloaded good, very slowly but good! The second one is a big one: more than 25000 files in it: It started to reload slowly until +/- 6500 files.. but I was obliged to close the eJukebox rebuild box, because my PC was almost 100% paralysed by this process (only the mouse is not paralysed). I think the problem is the RAM memory of my PC (1024 Mo) becomes completely saturated during the loading of song datas (some songs, the first song of each album in particular, are very long to load - all my "old" albums include id3 images.. It seems the image loading process is very slow), while the processor is not used a lot! So during the database rebuild my PC is totally unusable, and the update is so slow than I can't reload a big folder until the end: 24H was insufficient! For the big folder, it only loaded 7000 files during a day..

Audiosoft, I don't know if my PC is in question or eJukebox??

Thanks.


I hate to say it, my system is not in question, that I'm aware of. This sytstem was built for Media (Windows MCE) came stock. It pretty much plays everything that I've come up with. Mine is doing the same thing you mentioned, crashes right at 556 (I'm trying something now, removed "Bob Segar" the file it crashed on, but it plays fine, in many players...) of my 8,000+ tracks. Granted, some (many) are .WMA (silly me, I listened to a friend / aquaintance that works at my ISP to use WMA fomrat,.... )


EDIT:! Jus in: (315pm) I moved Bob Segar and it continued now.... in looking further there is an "&" in the tag.... Found it I Think!!!!


Audiosoft - 5-15-2007 at 10:17 PM

Is the Bob Segar song it crashes on a wma or mp3?


jojo - 5-15-2007 at 11:31 PM

Quote:
Originally posted by Audiosoft
Is the Bob Segar song it crashes on a wma or mp3?


It's .wma

I thought I had it, but now it's crashing, much farther along,

EDIT: 08:45a 5/16 I'm still having some problems with this, I've not been able to do a full import of my library, it stops at 5185 of near 8500+ tracks. I'll keep looking into it, strange characters in the tags, or incomplete tags. So far, I've not found the culprit, other than a guess. I've noticed some of the files are in the format of: C:MediaMusic%artist_Name%albumtr#-title

I'll be working on that today and report back.

I seem to still have a lot of "artist 0" in the library, though I think the above reason tells me why. (they are All .wma)

jojo


Pirk - 5-16-2007 at 06:13 PM

Sadely as I restarted eJukebox since my yesterday folders rebuilding attempt, after a long eJukebox starting delay (PC 100% paralysed..), my database just rised back to 7255 songs, from more than 40000 files before the update... :( :( :(


jojo - 5-16-2007 at 06:24 PM

It looks like our issues are related.... on one part it makes me feel better that it's not just me.... Makes it easier to go through everything.


:o:o 40,000 Are you kidding me?! Woa! and I thought I had a lot of music, with a very extensive collection. I can't even fathom how many gigs that takes up. I was looking over my library this go-around and noticed that my library takes 49 Gb now, which in itself is decent LOL

jojo :P


Pirk - 5-16-2007 at 06:37 PM

Yeah man, 40000! I can give you a trick: if you want eJukebox manages that much songs, you must go through all your songs with a fine-tooth comb BEFORE to import them in eJ. My 40,000 songs/tags are totally clean, and eJukebox works perfectly good with them. The bad idea was to try to remove some unwanted eJukebox popularity tags using a external editor.. Otherwise all is fine! :D


jojo - 5-16-2007 at 07:54 PM

Quote:
Originally posted by Pirk
Yeah man, 40000! I can give you a trick: if you want eJukebox manages that much songs, you must go through all your songs with a fine-tooth comb BEFORE to import them in eJ. My 40,000 songs/tags are totally clean, and eJukebox works perfectly good with them. The bad idea was to try to remove some unwanted eJukebox popularity tags using a external editor.. Otherwise all is fine! :D


Thnx for that :) I thought my tags and files were clean. I re-did all of my Cd's probally in '05 but in that time other players moved them out of order. it seems most are only just %tr#-title << explains the "0" or "1" as the artist, now... I'm fixing all of that today.


Pirk - 5-16-2007 at 08:07 PM

OK jojo, I think you are on the right way: Perfect tags will save you many -even all- future problems in eJukebox.. The thing is to start!
As far as I'm concerned I like to play with fire..


Audiosoft,

That would be great if eJukebox was able to manage its own "asn" tags using the song editor: Reset popularity or rating tags for a song, or a complete album. Even maybe the AutoList Builder could be used to select a targeted group of songs.. All the changes would be saved in the song files, of course! Not only in the database.. In anticipation of any future database rebuild! :o


jojo - 5-16-2007 at 08:28 PM

Quote:
Originally posted by Pirk
OK jojo, I think you are on the right way: Perfect tags will save you many -even all- future problems in eJukebox.. The thing is to start!
As far as I'm concerned I like to play with fire..


Yep me too LOL I have to do something when I'm having a boring week, and reading the news is not a good idea.

I finally took a look at tag&rename. Why I didn't buy it before now I have no idea... I was using Dr. Tag, which I did buy but now hasn't had an update for over 4 years or more :(


Pirk - 5-16-2007 at 08:40 PM

Yeah tag&rename is very handy.. There is also a new tag editor, well new at least for me: "The Godfather". It's a freeware but it seems quite good.
Good luck with your songs and eJukebox! ;)


Audiosoft - 5-16-2007 at 11:18 PM

Maybe you guys should try turning off antivirus when building a large database since antivirus tends to hog the harddrive and slow things down.

Also, if you do find that an audio file is causing the crash please attach it to a post so I can try to get eJukebox to work with it.


Pirk - 5-17-2007 at 12:32 PM

Thanks for your advise Audiosoft, since I've turned off my antivirus the database rebuilding doesn't freeze my system. My PC still slow down but it is not frozen. And the eJukebox database updater continue to make its valorous job in the background while I write this message! That was not the case with the antivirus turned on..

Suggestion: It's a Tip -"Turn off your antivirus during a big database update, to speed-up the process"- that would deserve to be displayed somewhere in the eJukebox database updater dialogues! :o Because I already knew that, but I forgot it..

Aside Question: Your forums was inaccessible for me since my last posts: Is it you Audiosoft who blocked me?? or the CIA? :D


jojo - 5-17-2007 at 06:51 PM

Audiosoft, is there a tool I can use to find out why my tracks fail to import (Crash EJ) I did some tag work and renaming and moving files, but now I'm getting the crash on tracks that worked before.

I'm moving files to:

C:MediaMusic%artist%Album%TR#-%artist-%tittle.xxx

xxx=file type wma, mp3 etc.

Of course all this, I've not even had a chance to get to the tracks that come in as artist "0" <sigh> Is there some way that EJ can report the problem, or have some kind of ability to continue importing other files and reporting problem tracks.

I'm open to ideas here.


Pirk - 5-17-2007 at 08:20 PM

Well, it seems we are both in the misery..

Audiosoft, in my last post I said things become better for me, but unfortunately that was only temporary: The database update worked good from 0 to about 25400 files, but it suddenly deteriorates with no apparent reason! The update became very slow again for the first song of each album (id3 image..), and my PC was again 99% paralized, even if the database update continue slowly.. I can write this post because it has just finished from 25400 to 29314 files imported.. So it took all the afternoon for only 3914 supplementary files imported! And I've not finished.. but I hesitate to start another importation.
I'm quite sure that my problems are related to the virtual RAM memory management, which becomes very slow -and freeze all my system- at some point during the database update process. Strange!? It seems the antivirus is not the unique responsible..

I'm also open to ideas!


Audiosoft - 5-17-2007 at 10:03 PM

Pirk,

Interesting you mention virtual ram. Tell you what...I will post an 4.62 ejukebox.exe that always runs the database update 'in ram' so you can see if it is faster/more stable that way. I am also going to make it so the db.m3u's last file will always be the last song that was attempted to be tag read/added to the database. That way if there is a problem eJukebox will skip over it when you add new files.

As far as 99% CPU - the only known issue that can cause this is incompleted music file downloads...particularly incomplete torrent downloads. Also I discovered eJukebox was attempting to read in ID3 tags on non mp3/mpc files which was slowing it down a little. That has also been fixed so non mp3/mpc will be added faster.

Also, when the database update freezes or fails you should then just go in and "Add new files"...instead of rebuilding the whole thing again. If you do "add new files" eJukebox should pickup where it left off.

v4.62 is now available for download from the forum under Latest Updates.


jojo - 5-17-2007 at 10:39 PM

Quote:
Originally posted by Audiosoft
Pirk,

Interesting you mention virtual ram. Tell you what...I will post an 4.62 ejukebox.exe that always runs the database update 'in ram' so you can see if it is faster/more stable that way. I am also going to make it so the db.m3u's last file will always be the last song that was attempted to be tag read/added to the database. That way if there is a problem eJukebox will skip over it when you add new files.


Also, when the database update freezes or fails you should then just go in and "Add new files"...instead of rebuilding the whole thing again. If you do "add new files" eJukebox should pickup where it left off.

v4.62 is now available for download from the forum under Latest Updates.


This sounds like a great way to handle this problem and take care of at least the library. Perhaps, is it possible? can EJ write problems to a log of sorts? So, perhaps we can help pinpoint this would be nice.

I look forward to the update :) Keep up the great work.


Audiosoft - 5-17-2007 at 10:48 PM

Link to 4.62 Download


jojo - 5-18-2007 at 01:19 AM

Quote:
Originally posted by Audiosoft
Link to 4.62 Download


Right off, I notice displays are MUCH! faster ;) Seems to be anyway. Very nice improvements.... I like ... Thank you so much for helping me keep my sanity.


Pirk - 5-18-2007 at 10:36 AM

Thanks a lot Audiosoft! I will try that this afternoon, now I go to eat. ;)


Pirk - 5-18-2007 at 12:05 PM

Well.. I've just tried to add some files to the database using ej 4.62, but things are not better for me. My system is a bit less freezed during the update process, but it is still extremely slow... :( The importation of the first song of each album is even more slow than with 4.61: more than 2 minutes with 4.61, about 3 min 20s... with 4.62) So it still takes ages to import new albums! Maybe should I remove all the id3 images of my albums?
I managed to take a screenshot during the database update.. Audiosoft, do you think that all these material faults on the resource monitor are normals?? :o


Well_Jaggy - 5-18-2007 at 02:58 PM

Hey Pirk,

I have had the same problem since around 4.2, but I just put it down to my PC as it only had 384MB ram in it. 2gh pentium4

When I last re-built the database (about 2 months ago roughly) it took almost 48 hours to add 27,000 songs. The PC its installed on is standalone and does not access the web at all. It has no firewall, anti virus or anything else running, in fact I have even stopped all non essential services from running at startup, but still it took 2 full days to re-build.

I am ok for now as it has been pretty stable for a while, but I fear for it happening again! Other than that I love EJ!


Pirk - 5-18-2007 at 03:56 PM

Hi Well_Jaggy,

48 hours for 27,000 songs? If you have only 384MB ram maybe it's "normal" it took a long time, I don't know..
In my case I haved not made a full rebuild since a very long time... I can't remember if even I haved not copied my database from XP to Vista! Only as these last days I've removed a lot of unwanted Audiosoft popularity tags in my mp3s using a external editor, now I need to rebuild otherwise eJukebox will re-write its old "asn" datas in my files..
OK, so what is very strange for me is eJukebox has imported more than 25,000 files in a morning, then suddenly (and sadely..) the scanning process performance fallen down with no apparent reason!
The only thing I've changed these last days is when Audiosoft put a version of eJukebox that requested a online registration, 4.59 I think. Then before he posts a fixed version I haved reinstalled a quite old version.. Once he posted the fixed version 4.60, I've made a full install over the old version, but maybe I breaked something in the eJukebox install?? That's crazy!


Audiosoft - 5-18-2007 at 08:15 PM

Pirk,

Do you have enough free hard-drive space for the 'Temporary Internet Files' IE7 folder? I will do my best to get the database update to import mp3s with the id3 embedded images faster. Also I am going to remove the run in ram from the database update for the next version since that doesn't seem to be helping when you don't have allot of ram. I will also look into the memory faults.


Pirk - 5-18-2007 at 09:29 PM

Audiosoft, thanks for your help..

I've just tried to move the temporary internet folder on another disk on which there is more free space, there was only 9Gb free on the system disk, but the database update is not faster than before.. I've also increased the temporary internet folder to the maximum size, I don't know if that can help.. And I haved already tried to delete the temporary internet files.

Do you think that would help if I try to remove the id3 images? The cover.jpg image importation will be faster than embedded images??
EDIT: I've tried to import a album without id3 image, cover.jpg only.. but it seems that's not faster!!! :( Also probably that often I use too large images..

Memory faults: I've read on the web that it's not real "faults", but just when windows can't find datas in RAM then it counts "a fault", and it takes datas from the disk instead..

Thanks.

PS: In my previous posts I said the first 25,000 files was added quite fast. Now I'm thinking that even if the Homepage displayed 7500 songs remaining in the database after the "initial" crash, maybe many images have been recovered (from where?) during the first rebuild? That would explain why the 25,000 first files were faster to add than the following...

PS #2: I'm also thinking that 1024Mb it's not that much for Vista!! As the system monopolizes 600Mb.. it only remains 424Mb for eJukebox!
So I'll try to add more RAM. How much RAM can manage Vista 32 bits? 2Gb, 4Gb?


jojo - 5-18-2007 at 09:49 PM

Hi Audiosoft,

Well, it 4.62 is faster, as promised however it's not doing what we were hoping it would, as far as keep going when a track fails to inport. It seems that there are some stability issues when inporting still.

I've not been able to get a successful library add. It crashes on both WMA and MP3 It seems to crash on tracks that were accepted last night.

I did attempt a re-build since I've been moving and renaming the tracks.

I'm open to ideas, I'd love to help get this fixed up. Below is most recent crashing song


Audiosoft - 5-19-2007 at 02:29 AM

Quote:

Do you think that would help if I try to remove the id3 images? The cover.jpg image importation will be faster than embedded images??


Yeah no point in doing that since cover.jpg and id3 embedded images get added to the database the same way. Extremely large images will take longer. eJukebox used to add them as JPG to the database with 90% quality. I changed it to 100% quality with 4.60 so that there will be no loss of quality. The only thing is this makes the size of the jpg's in the database larger and slower to add. Maybe I should change it back to 90% quality. What do you think?


jojo,

With v4.62 the last line in the db.m3u will be the last file attempted to be added to the database. So check that file if it locks up again and post the file here so I can test with it.


jojo - 5-19-2007 at 06:47 AM

Quote:
Originally posted by Audiosoft
Pirk,

Do you have enough free hard-drive space for the 'Temporary Internet Files' IE7 folder? I will do my best to get the database update to import mp3s with the id3 embedded images faster. Also I am going to remove the run in ram from the database update for the next version since that doesn't seem to be helping when you don't have allot of ram. I will also look into the memory faults.


Thanks, Audiosoft.... for the continuing help on this issue. I've had so many crashes it's hard figure what it is, There doesn't seem to be any pattern, it even crashes on songs it accepted earlier.

Edit: I was sitting here, thinking of the disk space issue. The HTPC has plenty of drive available...(off topic a bit, but not) My own PC has been giving me "drive is full" I run the disk cleanup, it gives me some... but almost nothing... Then I reboot and I have 50 GB avail ???! I've never seen this happen before. This is on XP Home with 1.25 GB


jojo - 5-19-2007 at 06:54 AM

Quote:
Originally posted by Audiosoft
Quote:

Do you think that would help if I try to remove the id3 images? The cover.jpg image importation will be faster than embedded images??


Yeah no point in doing that since cover.jpg and id3 embedded images get added to the database the same way. Extremely large images will take longer. eJukebox used to add them as JPG to the database with 90% quality. I changed it to 100% quality with 4.60 so that there will be no loss of quality. The only thing is this makes the size of the jpg's in the database larger and slower to add. Maybe I should change it back to 90% quality. What do you think?


jojo,

With v4.62 the last line in the db.m3u will be the last file attempted to be added to the database. So check that file if it locks up again and post the file here so I can test with it.


I was thinking the images looked really sharp in the current versions, I guess I attributed that to re-doing all tags and renaming.

As for the crashes, I'ts been bad... Really bad today :( I pretty much just pulled each album that gave me trouble. I'll re-rip them to MP3 next week, or when I get a chance. There have been many times I'd only get a partial name (Path only) not the actual file that failed.... So that hasn't been so helpful, other than giving me the album.


Pirk - 5-19-2007 at 10:23 AM

Quote:
Message original : Audiosoft
Extremely large images will take longer. eJukebox used to add them as JPG to the database with 90% quality. I changed it to 100% quality with 4.60 so that there will be no loss of quality. The only thing is this makes the size of the jpg's in the database larger and slower to add. Maybe I should change it back to 90% quality. What do you think?

I would prefer you keep 100% QUALITY! Even if it's slower to import the images, eJukebox will look better! :) I will try to boost my PC adding more RAM..

Thanks.


Pirk - 5-19-2007 at 10:33 AM

Quote:
Message original : jojo
I was thinking the images looked really sharp in the current versions...


Same here! I noticed my skin looks better, in particular the songlist.. I was thinking Audiosoft has improved the transparency!! :D

Otherwise concerning your problems, just a idea if you use Tag&rename: Have you unchecked the option "Write unicode data in id3v2 tags"? because eJukebox is incompatible with unicode..


Pirk - 5-19-2007 at 12:18 PM

Audiosoft,

Could you make so eJukebox doesn't paralize the system during the database updates? The processor is not used a lot but even so it's almost impossible to use the PC during a update, in fact each time it loads a image all the RAM is used and the system freezes (see my screenshot).. I think it's not normal: the database update can be slow without it necessary freezes the system, no?

Thanks.


Audiosoft - 5-20-2007 at 12:41 AM

4.63 makes the database import faster on songs with an id3 embedded image/cover/folder.jpg image.
Give it a try and let me know how it performs.

Download 4.63


Pirk - 5-20-2007 at 11:01 AM

Audiosoft,

Once more you rooted me to the spot: 4.63 works at the speed of a rocket!! :o
But how can you make it goes from extremely slow to so fast?? Are you sure that 4.63 has still enough time to import images, at this boosted speed? :D What is your secret?!

Well, now I'm got over this new version -My database is now up to date! It imported the last 1800 files so quickly..- I can say a little thing: At the very beginning of the database update, my system was 99,9% freezed during maybe 2 minutes, but then the booster taked up his post and it imported the remaining files in less than.. time to say it! :D

Thanks a lot for this efficient update Audiosoft! I think I'll save some money on RAM.. although prices have fallen much.


Pirk - 5-20-2007 at 04:09 PM

Audiosoft,

That's right, with 4.63 I noticed that each time I import a new group of albums, the update process first scan the folders very fast (like before), then as it seems to import the first song my system freezes during maybe 1 or 2 minutes.. But since this version all the following songs and albums are added torrentially and during the database update my system is not freezed at all! So the version 4.63 is already a hell of a progress.. :)

Thanks.


Audiosoft - 5-21-2007 at 01:07 AM

Pirk,

wow! so it went from 48 hours for 27,000 to only 2 hours for 40,500 with v4.63...very impressive!! The reason is is so much faster is because eJukebox now turns the images into jpg on the fly instead writing a bmp to the drive first. Also it previously filled a recordset with all the image data in the database every time a new cover was imported....now it only does that one time at the beginning of the update process.


Pirk - 5-21-2007 at 12:18 PM

Audiosoft,

OK, thanks for your explanations. 48 hours for 27,000: Well it's not me.. In my case that was to slow, but furthermore, the database update was also very erratic because of the system freezing.. phew! In any case, you made a nice piece of coding.. Bravo! :cool:

Just a crazy dream which goes through my mind: If ever you could boost the ALBUMLIST construction in the same way! :o

Thanks again.