Your Digital Media Has Never Looked So Good

 
goattee
Topic Author
Posts: 40
Joined: Thu Oct 04, 2007 4:22 pm
Location: Bangkok, Thailand
Contact:

Suddenly Firefly is consuming 90%+ CPU

Mon Mar 02, 2009 7:25 am

I have been using Firefly svn-1586 for months. I have about 700G of files on a RAID array (Promise NS4300N) accessed by UNC.

It has reliably taken 45-55 minutes to perform an incremental database scan. But ver the past few days, it is now taking hours to scan a very few folders. The host machine is now showing > 90% CPU for the Firefly process.

Restarting the service has not rectified the problem.

Rebooting the RAID array and the server computer has not rectified the problem.

I can access the RAID array directly over the network and am not noticing unusually slow disk I/O (at least when Firefly is not running).

Any ideas on what might cause this behavior?
 
stretch
Posts: 623
Joined: Fri Dec 16, 2005 12:29 am
Location: Australia

Tue Mar 03, 2009 1:55 am

Sounds like Firefly has crashed or something.
Set error logging to level 9 and restart Firefly.

Examine the resulting log file and post the appropriate sections.
If there's an "aborting" message when what's happening leading up to the abort message is important.

You also need to look at what's happening at startup. ie. is Firefly self initiating a full db rebuild at startup.

To make things easier, delete any existing error log file. That way you only have to look at the beginning (start up) & end of the file (crash?)
2 x M2000's
Infrant ReadyNAS NV+ with Firefly svn-1676
NSLU2, 500GB Maxtor One Touch III, uNSLUng 6.8, Firefly svn-1696
music library in FLAC format
 
goattee
Topic Author
Posts: 40
Joined: Thu Oct 04, 2007 4:22 pm
Location: Bangkok, Thailand
Contact:

Log: startup phase

Tue Mar 03, 2009 3:14 am

I actually have been monitoring the log with a tail utility. But I restarted a few minutes ago and have some evidence.

This segment shows the initial phase. It moves along at a rapid pace:

------------------------

2009-03-03 16:45:53 (d9c6e7f2): Firefly Version svn-1586: Starting with debuglevel 9
2009-03-03 16:45:53 (d9c6e7f2): Attempting to load plugin C:\Program Files\Firefly Media Server\plugins\out-daap.dll
2009-03-03 16:45:53 (d9c6e7f2): Loaded plugin C:\Program Files\Firefly Media Server\plugins\out-daap.dll (daap/svn-1586)
2009-03-03 16:45:53 (d9c6e7f2): New transcode codec list:
2009-03-03 16:45:53 (d9c6e7f2): Attempting to load plugin C:\Program Files\Firefly Media Server\plugins\rsp.dll
2009-03-03 16:45:53 (d9c6e7f2): Loaded plugin C:\Program Files\Firefly Media Server\plugins\rsp.dll (rsp/svn-1586)
2009-03-03 16:45:53 (d9c6e7f2): New transcode codec list:
2009-03-03 16:45:53 (d9c6e7f2): Attempting to load plugin C:\Program Files\Firefly Media Server\plugins\ssc-ffmpeg.dll
2009-03-03 16:45:54 (d9c6e7f2): Loaded plugin C:\Program Files\Firefly Media Server\plugins\ssc-ffmpeg.dll (ssc-ffmpeg/svn-1586)
2009-03-03 16:45:54 (d9c6e7f2): New transcode codec list: flac,alac,ogg,wma
2009-03-03 16:45:54 (d9c6e7f2): Attempting to load plugin C:\Program Files\Firefly Media Server\plugins\ssc-wma.dll
2009-03-03 16:45:54 (d9c6e7f2): Loaded plugin C:\Program Files\Firefly Media Server\plugins\ssc-wma.dll (ssc-wma/svn-1586)
2009-03-03 16:45:54 (d9c6e7f2): New transcode codec list: wma,wmal,wmap,wmav,flac,alac,ogg,wma
2009-03-03 16:45:54 (d9c6e7f2): Attempting to load plugin C:\Program Files\Firefly Media Server\plugins\w32-event.dll
2009-03-03 16:45:54 (d9c6e7f2): Loaded plugin C:\Program Files\Firefly Media Server\plugins\w32-event.dll (w32-event/svn-1586)
2009-03-03 16:45:54 (d9c6e7f2): New transcode codec list: wma,wmal,wmap,wmav,flac,alac,ogg,wma
2009-03-03 16:45:54 (d9c6e7f2): Plugin loaded: w32-event/svn-1586
2009-03-03 16:45:54 (d9c6e7f2): Plugin loaded: ssc-wma/svn-1586
2009-03-03 16:45:54 (d9c6e7f2): Plugin loaded: ssc-ffmpeg/svn-1586
2009-03-03 16:45:54 (d9c6e7f2): Plugin loaded: rsp/svn-1586
2009-03-03 16:45:54 (d9c6e7f2): Plugin loaded: daap/svn-1586
2009-03-03 16:45:54 (d9c6e7f2): Starting rendezvous daemon
2009-03-03 16:45:54 (d9c6e7f2): Building drive mapping table from C:\Program Files\Firefly Media Server\mapping.ini
2009-03-03 16:45:54 (d9c6e7f2): Mapped m to \\storage2\MUSIC\
2009-03-03 16:45:54 (d9c6e7f2): Mapped o to \\Storage2\BOOKS\
2009-03-03 16:45:54 (d9c6e7f2): Mapped r to \\storage\Radio\
2009-03-03 16:45:54 (d9c6e7f2): Mapped u to \\Storage2\BACKUPS\
2009-03-03 16:45:54 (d9c6e7f2): Mapped v to \\Storage2\VIDEO\
2009-03-03 16:45:54 (d9c6e7f2): Mapped w to \\storage\Video\
2009-03-03 16:45:54 (d9c6e7f2): Mapped x to \\Storage2\DRIVERS\
2009-03-03 16:45:54 (d9c6e7f2): Mapped z to \\Storage2\DOWNLOAD\
2009-03-03 16:45:54 (d9c6e7f2): Opening database
2009-03-03 16:45:54 (d9c6e7f2): Executing: select value from config where term='version'
2009-03-03 16:45:54 (d9c6e7f2): Results: 0
2009-03-03 16:45:54 (d9c6e7f2): Initializing database
2009-03-03 16:45:54 (d9c6e7f2): Executing: select count(*) FROM songs
2009-03-03 16:45:54 (d9c6e7f2): Executing: select value from config where term='rescan'
2009-03-03 16:45:54 (d9c6e7f2): Executing: vacuum
2009-03-03 16:46:16 (d9c6e7f2): Rows: 0
2009-03-03 16:46:16 (d9c6e7f2): Executing: create index idx_path on songs(path,idx)
2009-03-03 16:46:16 (d9c6e7f2): Query: create index idx_path on songs(path,idx)
2009-03-03 16:46:16 (d9c6e7f2): Error: index idx_path already exists
2009-03-03 16:46:16 (d9c6e7f2): Executing: create index idx_songid on playlistitems(songid)
2009-03-03 16:46:16 (d9c6e7f2): Query: create index idx_songid on playlistitems(songid)
2009-03-03 16:46:16 (d9c6e7f2): Error: index idx_songid already exists
2009-03-03 16:46:16 (d9c6e7f2): Executing: create index idx_playlistid on playlistitems(playlistid,songid)
2009-03-03 16:46:16 (d9c6e7f2): Query: create index idx_playlistid on playlistitems(playlistid,songid)
2009-03-03 16:46:16 (d9c6e7f2): Error: index idx_playlistid already exists
2009-03-03 16:46:16 (d9c6e7f2): Starting web server from C:\Program Files\Firefly Media Server\admin-root on port 9999
2009-03-03 16:46:16 (d9c6e7f2): Listening on port 9999
2009-03-03 16:46:16 (d9c6e7f2): Converting socket to fd
2009-03-03 16:46:16 (d9c6e7f2): Returning fd 512
2009-03-03 16:46:16 (d9c6e7f2): Starting server thread
2009-03-03 16:46:16 (d9c6e7f2): Registering rendezvous names
2009-03-03 16:46:16 (d9c6e7f2): Registering Marc & Jon's Music [VideoMedia:Firefly] as type (_http._tcp) on port 9999
2009-03-03 16:46:16 (d9c6e7f2): Checking w32-event/svn-1586
2009-03-03 16:46:16 (d9c6e7f2): Checking ssc-wma/svn-1586
2009-03-03 16:46:16 (d9c6e7f2): Checking ssc-ffmpeg/svn-1586
2009-03-03 16:46:16 (d9c6e7f2): Checking rsp/svn-1586
2009-03-03 16:46:16 (d9c6e7f2): Registering _rsp._tcp
2009-03-03 16:46:16 (d9c6e7f2): Registering Marc & Jon's Music [VideoMedia:Firefly] as type (_rsp._tcp) on port 9999
2009-03-03 16:46:16 (d9c6e7f2): Checking daap/svn-1586
2009-03-03 16:46:16 (d9c6e7f2): Registering _daap._tcp
2009-03-03 16:46:16 (d9c6e7f2): Registering Marc & Jon's Music [VideoMedia:Firefly] as type (_daap._tcp) on port 9999
2009-03-03 16:46:16 (d9c6e7f2): Executing: select count(*) FROM songs
2009-03-03 16:46:16 (d9c6e7f2): Serving 45349 songs. Startup complete in 23 seconds
2009-03-03 16:46:16 (d9c6e7f2): Rescanning database
2009-03-03 16:46:16 (d9c6e7f2): Starting scan_init
2009-03-03 16:46:16 (d9c6e7f2): Starting db scan
2009-03-03 16:46:16 (d9c6e7f2): Executing: drop table updated
2009-03-03 16:46:16 (d9c6e7f2): Query: drop table updated
2009-03-03 16:46:16 (d9c6e7f2): Error: no such table: updated
2009-03-03 16:46:16 (d9c6e7f2): Executing: create temp table updated (id int)
2009-03-03 16:46:16 (d9c6e7f2): Rows: 0
2009-03-03 16:46:16 (d9c6e7f2): Executing: drop table plupdated
2009-03-03 16:46:16 (d9c6e7f2): Query: drop table plupdated
2009-03-03 16:46:16 (d9c6e7f2): Error: no such table: plupdated
2009-03-03 16:46:16 (d9c6e7f2): Executing: create temp table plupdated(id int)
2009-03-03 16:46:16 (d9c6e7f2): Rows: 0
2009-03-03 16:46:16 (d9c6e7f2): Scanning for MP3s in \\pacifictime\radio
2009-03-03 16:46:17 (93aa350b): Got a reply for Marc & Jon's Music [VideoMedia:Firefly]._http._tcp.local.
2009-03-03 16:46:17 (93aa350b): Name now registered and active
2009-03-03 16:46:17 (93aa350b): Got a reply for Marc & Jon's Music [VideoMedia:Firefly]._rsp._tcp.local.
2009-03-03 16:46:17 (93aa350b): Name now registered and active
2009-03-03 16:46:17 (93aa350b): Got a reply for Marc & Jon's Music [VideoMedia:Firefly]._daap._tcp.local.
2009-03-03 16:46:17 (93aa350b): Name now registered and active
2009-03-03 16:46:21 (d9c6e7f2): Found \\pacifictime\radio/.DS_Store
2009-03-03 16:46:21 (d9c6e7f2): Found \\pacifictime\radio/.TemporaryItems
2009-03-03 16:46:21 (d9c6e7f2): Found .TemporaryItems.. recursing
2009-03-03 16:46:21 (d9c6e7f2): Found \\pacifictime\radio\.TemporaryItems/folders.501
2009-03-03 16:46:21 (d9c6e7f2): Found folders.501.. recursing
2009-03-03 16:46:21 (d9c6e7f2): Found \\pacifictime\radio/._.TemporaryItems
2009-03-03 16:46:21 (d9c6e7f2): Found \\pacifictime\radio/Cafe LA
2009-03-03 16:46:21 (d9c6e7f2): Found Cafe LA.. recursing
2009-03-03 16:46:21 (d9c6e7f2): Found \\pacifictime\radio\Cafe LA/Cafe LA 2009-03-02 [18-01] _01.mp3
2009-03-03 16:46:21 (d9c6e7f2): Executing: select * from songs where path='\\pacifictime\radio\Cafe LA\Cafe LA 2009-03-02 [18-01] _01.mp3' and idx=0
2009-03-03 16:46:21 (d9c6e7f2): Found music file: Cafe LA 2009-03-02 [18-01] _01.mp3
2009-03-03 16:46:21 (d9c6e7f2): Codec type: mpeg
2009-03-03 16:46:22 (d9c6e7f2): Genre: Replay AV
2009-03-03 16:46:22 (d9c6e7f2): Artist: Tom Schnabel
 
goattee
Topic Author
Posts: 40
Joined: Thu Oct 04, 2007 4:22 pm
Location: Bangkok, Thailand
Contact:

Log: slowdown and increased CPU

Tue Mar 03, 2009 3:17 am

It is currently 17:09 and there has not been another log entry since 16:58. Past logs show that it could be 45-60 min or more until the next entry appears. This can go on for hours without reaching the end of the scan.

----------------------------------

2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Tanto Tempo Remixes - Index.jpg
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Tanto Tempo Remixes - Index_0.jpg
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 07 - Alguém (Mix Ananda Project).mp3
2009-03-03 16:58:43 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 07 - Alguém (Mix Ananda Project).mp3' and idx=0
2009-03-03 16:58:43 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758476)
2009-03-03 16:58:43 (d9c6e7f2): Rows: 1
2009-03-03 16:58:43 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 02 - Sem Contencao (Mix Trby Trio).mp3
2009-03-03 16:58:43 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 02 - Sem Contencao (Mix Trby Trio).mp3' and idx=0
2009-03-03 16:58:43 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758477)
2009-03-03 16:58:43 (d9c6e7f2): Rows: 1
2009-03-03 16:58:43 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 11 - Tanto Tempo (Mix Chari Chari).mp3
2009-03-03 16:58:43 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 11 - Tanto Tempo (Mix Chari Chari).mp3' and idx=0
2009-03-03 16:58:43 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758478)
2009-03-03 16:58:43 (d9c6e7f2): Rows: 1
2009-03-03 16:58:43 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 12 - Samba Da Benção (Mix 4Hero).mp3
2009-03-03 16:58:43 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 12 - Samba Da Benção (Mix 4Hero).mp3' and idx=0
2009-03-03 16:58:43 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758479)
2009-03-03 16:58:43 (d9c6e7f2): Rows: 1
2009-03-03 16:58:43 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 13 - August Day Song (Mix Ripped by Winamp).mp3
2009-03-03 16:58:43 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 13 - August Day Song (Mix Ripped by Winamp).mp3' and idx=0
2009-03-03 16:58:43 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758480)
2009-03-03 16:58:43 (d9c6e7f2): Rows: 1
2009-03-03 16:58:43 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 03 - August Day Song (Mix Chateau Flight).mp3
2009-03-03 16:58:43 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 03 - August Day Song (Mix Chateau Flight).mp3' and idx=0
2009-03-03 16:58:43 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758481)
2009-03-03 16:58:43 (d9c6e7f2): Rows: 1
2009-03-03 16:58:43 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Tanto Tempo Remixes - Back.jpg
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Tanto Tempo Remixes - Back-inside.jpg
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Tanto Tempo Remixes - Index_1.jpg
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 05 - Mais Feliz (Mix Monoaural).mp3
2009-03-03 16:58:43 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 05 - Mais Feliz (Mix Monoaural).mp3' and idx=0
2009-03-03 16:58:43 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758482)
2009-03-03 16:58:43 (d9c6e7f2): Rows: 1
2009-03-03 16:58:43 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 08 - Sem Contenção (Mix Sin Plomo).mp3
2009-03-03 16:58:43 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 08 - Sem Contenção (Mix Sin Plomo).mp3' and idx=0
2009-03-03 16:58:43 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758483)
2009-03-03 16:58:43 (d9c6e7f2): Rows: 1
2009-03-03 16:58:43 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Tanto Tempo Remixes - CD - 200dpi.jpg
2009-03-03 16:58:43 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Tanto Tempo Remixes - Front.jpg
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 04 - Tanto Tempo (Mix Peter Kruder).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 04 - Tanto Tempo (Mix Peter Kruder).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758484)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 06 - So Nice (Summer Samba) (Mix Mario Caldato Jr.).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 06 - So Nice (Summer Samba) (Mix Mario Caldato Jr.).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758485)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 09 - Close Your Eyes (Mix Faze Action).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 09 - Close Your Eyes (Mix Faze Action).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758486)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)/Bebel Gilberto - Tanto Tempo Remixes - 10 - August Day Song (Mix Da Lata).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Tanto Tempo (Remixed)\Bebel Gilberto - Tanto Tempo Remixes - 10 - August Day Song (Mix Da Lata).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758487)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto/Bebel Gilberto (Remixed)
2009-03-03 16:58:44 (d9c6e7f2): Found Bebel Gilberto (Remixed).. recursing
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)/Bebel Gilberto - Bebel Gilberto Remixed - 05 - Winter (Nuspirit Helsinki Dub).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)\Bebel Gilberto - Bebel Gilberto Remixed - 05 - Winter (Nuspirit Helsinki Dub).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758488)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)/Bebel Gilberto - Bebel Gilberto Remixed - 04 - Aganjú (Latin Project Mix).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)\Bebel Gilberto - Bebel Gilberto Remixed - 04 - Aganjú (Latin Project Mix).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758489)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)/Bebel Gilberto - Bebel Gilberto Remixed - 07 - All Around (Telefon Tel Aviv Mix).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)\Bebel Gilberto - Bebel Gilberto Remixed - 07 - All Around (Telefon Tel Aviv Mix).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758490)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)/Bebel Gilberto - Bebel Gilberto Remixed - 08 - Cada Beijo (Thievery Corporation Mix).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)\Bebel Gilberto - Bebel Gilberto Remixed - 08 - Cada Beijo (Thievery Corporation Mix).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758491)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)/Bebel Gilberto - Bebel Gilberto Remixed - 12 - Every Day You've Been Away (Monoaural Mix).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)\Bebel Gilberto - Bebel Gilberto Remixed - 12 - Every Day You''ve Been Away (Monoaural Mix).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758492)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)/Bebel Gilberto - Bebel Gilberto Remixed - 02 - Simplesmente (Tom Moddleton Cosmos Mix).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)\Bebel Gilberto - Bebel Gilberto Remixed - 02 - Simplesmente (Tom Moddleton Cosmos Mix).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758493)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Skipping file, not modified
2009-03-03 16:58:44 (d9c6e7f2): Found \\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)/Bebel Gilberto - Bebel Gilberto Remixed - 01 - Aganjú (John Beltran Mix).mp3
2009-03-03 16:58:44 (d9c6e7f2): Executing: select * from songs where path='\\storage2\Music\Bebel Gilberto\Bebel Gilberto (Remixed)\Bebel Gilberto - Bebel Gilberto Remixed - 01 - Aganjú (John Beltran Mix).mp3' and idx=0
2009-03-03 16:58:44 (d9c6e7f2): Executing: INSERT INTO updated VALUES (2758494)
2009-03-03 16:58:44 (d9c6e7f2): Rows: 1
2009-03-03 16:58:44 (d9c6e7f2): Found music file: Bebel Gilberto - Bebel Gilberto Remixed - 01 - Aganjú (John Beltran Mix).mp3
2009-03-03 16:58:44 (d9c6e7f2): Codec type: mpeg
 
stretch
Posts: 623
Joined: Fri Dec 16, 2005 12:29 am
Location: Australia

Re: Log: slowdown and increased CPU

Wed Mar 04, 2009 12:37 am

goattee wrote:
ú
Firefly is known to have problems with special characters

Try removing the characters from this track
2009-03-03 16:58:44 (d9c6e7f2): Found music file: Bebel Gilberto - Bebel Gilberto Remixed - 01 - Aganjú (John Beltran Mix).mp3
2 x M2000's
Infrant ReadyNAS NV+ with Firefly svn-1676
NSLU2, 500GB Maxtor One Touch III, uNSLUng 6.8, Firefly svn-1696
music library in FLAC format
 
goattee
Topic Author
Posts: 40
Joined: Thu Oct 04, 2007 4:22 pm
Location: Bangkok, Thailand
Contact:

Wed Mar 04, 2009 12:50 am

Try removing the characters from this track


I will try that. In the past when I ran into trouble it was only with .flac files. And in those cases the log showed inability to insert the files into the database.

But your theory is viable. I reset the log to debuglevel 7 and restarted. I have kept the scan going and it does seem that there are long pauses when another file with embedded special characters is encountered.
 
goattee
Topic Author
Posts: 40
Joined: Thu Oct 04, 2007 4:22 pm
Location: Bangkok, Thailand
Contact:

You found the cause of the problem

Wed Mar 04, 2009 6:35 am

I am not sure what has changed in the last few days to make Firefly sensitive to the non-ASCII characters in the same MP3 filenames that have been in the NAS for a long time. But you were absolutely right.

I wrote an "action group" in MP3Tag to convert the objectionable characters to ASCII and have started up Firefly again. It's scanning at its traditional pace.

Thanks!
 
stretch
Posts: 623
Joined: Fri Dec 16, 2005 12:29 am
Location: Australia

Wed Mar 04, 2009 6:41 am

If you look at your log it actually processed some tracks with non-ASCII characters before choking on that one.
2 x M2000's
Infrant ReadyNAS NV+ with Firefly svn-1676
NSLU2, 500GB Maxtor One Touch III, uNSLUng 6.8, Firefly svn-1696
music library in FLAC format
 
goattee
Topic Author
Posts: 40
Joined: Thu Oct 04, 2007 4:22 pm
Location: Bangkok, Thailand
Contact:

Wed Mar 04, 2009 6:20 pm

You are right. I am bafflled as to why Firefly would be choking on the same files it has scanned before.

First I implemented the Action script to replace all non-ASCII filenames in MP3Tag. This took a few hours. Then I have been incrementally fixing all the files that it has been stopping for. I run the Tail for Windows utility and watch. When Firefly seems to be halting, I go fix the objectionable file's name.

I am doing my first scan since I let it run overnight and I think it will run without choking.

Who is online

Users browsing this forum: No registered users and 2 guests