TiVo-VideoReDo-AutoProcessor Program

[dlflannery]

WHAT IS IT?

A free utility program for TiVo Desktop users who use VideoReDo (Plus or TV Suite) for editing
transferred TiVo files. It runs on a Windows computer with VideoReDo (VRD) and TiVo Desktop
installed. TVAP detects TiVo files being transferred and, when transfer completes, it
automatically and silently runs VideoReDo processes on the files as configured by the
operator in the program GUI. QuickStream Fix (QSF) and/or Ad Detective scans ("Ad Scans")
may be run. Optionally, all three file types (.TiVo, QSF outputs and Ad Scan outputs)
are moved automatically to specified folders after processing is completed, or the original
.TiVo file is deleted. Output file types of MPEG2 (.mpg), DVD-VOB (.mpg), DVR-MS (.dvr-ms)
and TiVo (.tivo) are supported. ALL configuration is via the GUI - NO MANUALLY PREPARED
CONFIGURATION FILES ARE REQUIRED!

You can also select a .TiVo file and click a button to launch the "normal" (interactive GUI)
version of VideoReDo (Plus or TV Suite) with the file loaded. This allows you to set
Ad Detective parameters or just to preview the video (or anything else VRD can do).

Several metadata items are read from the TiVo files (e.g., Description, Genre, Subtitle/Episode,
Episode #, Movie Year, Recording Date/Time). These are displayed by right-clicking on the file
in the GUI file list and some of them are inserted in DVR-MS output files.

TVAP will run a batch file of your creation after processing each .mpg file.

You can configure to produce a project (.vprj) file with automatic (Ad Detective) cuts
as your output file. TVAP remembers this, then if you later review this project and save
with your modified cuts, TVAP will automatically call VRD to produce the final edited
output video with YOUR cuts.

EDIT 24 May 2008: TVAP has had many enhancements. Please see the TVAP-ReadMe.txt
file, including the change log at the end, at the download site: ftp://upload:upload@videoredo.net/VRD%20Add-Ons/TiVo-VideoReDo-AutoProcessor/


THE BOILERPLATE:

VideoReDo is a trademark of DRD Systems, Inc. TiVo is a trademark of TiVo, Inc.
TVAP is free and is not an official product of either VRD or TiVo, neither of
which are providing support for it, nor do they officially endorse it.

FEATURES:

- GUI Selection of VRD operations: Default and individual settings for each TiVo file.
Specific files may also be "blocked", so no processing occurs.

- GUI selection of whether DVD-VOB, MPEG2, DRV-MS or TiVo output file format is produced.

- GUI selection of whether Ad Scan produces only the project (.vprj) file or
automatically applies the cuts to produce a final edited output file.

- On first startup, reads the Desktop TiVo transfer folder from the Windows Registry.
If not detected, prompts the operator to select the folder to be monitored.

- Can launch independent GUI version of VideoReDo with TVAP-selected .TiVo file loaded.

- Totally automatic operation with real-time configuration allowed.

- Status of all .TiVo files in the transfer folder and all configuration settings,
are maintained in an XML data file between program runs, automatically updated
on startup.

- Maintains and displays a log file of processing actions.

- Shows file name, current processing action, and progress bar for VRD processes
and file moves.

- Many tooltip hints.

- Does not modify Windows Registry.

- TVAP is lightweight: Uses less than 20MB of memory exclusive of VRD requirements.
Uses less than 1% of processor time when just monitoring for .TiVo transfers.

- Minimizes to system tray.

- File Folder in .vprj file created by Ad Scan is automatically modified if the scanned
file was moved by TVAP (otherwise the .vprj file cannot be opened by VRD).

- For mpeg2 outputs, automatically generates a text metadata file that will automatically
be used by pyTivo transcoding server (http://pyTivo.armooo.net) to attach metadata to
files served back from pc to TiVo.

-- For mpeg2 outputs, if you place a batch file named TVAPpostProcess.bat or
TVAPpostProcess.cmd in the final destination directory TVAP will run the batch
file upon completion of VRD processing. The filename WITHOUT the .mpg extension
and without the path is passed as the argument to this batch file. No configuration
is necessary -- if the batch file is there it will be run.



VideoReDo has graciously allowed me to host the program on their FTP site. Point your
browser to ftp://upload:upload@videoredo.net/VRD%20Add-Ons/TiVo-VideoReDo-AutoProcessor/

Click on the readme file to learn more then click on the setupTVAP###.exe file to download the TVAP installer -- the
readme file is also included in the zip, along with the ultra simple installation
instructions.

Post here or PM me for questions or problems -- BUT please read the complete readme file
first, particularly the "THINGS TO KNOW" section.!

I hope TVAP is of some use to you!

[Anole]

I hope this makes life for TiVo fans as comfortable as the copy utility Phd wrote to import from home-burned DVDs.
Thanks for your efforts. :D

[dlflannery]

Two noticeable improvements (plus minor cleanup):

1. Minimizes to system tray icon. Click icon to minimize/restore program window.

2. Progress bar now active for file moves.

Readme file updated and added Change Log section at end.

[dlflannery]

Added ability to launch full-GUI VRD from TVAP with selected .TiVo file loaded.
This allows user to do anything normally possible in VRD, but in particular the
Ad Detective settings can be tuned and adjusted and they then will be used in TVAP Ad Scan processing. (You can also preview the .TiVo file, load another file etc.) TVAP's state doesn't change and it waits for you to shut down VRD before
it will do any auto-processing. See the readme for more info.

WARNING: When I clicked on the ftp link in the first post (repeated here: ftp://upload:upload@videoredo.net/VRD%20Add-Ons/TiVo-VideoReDo-AutoProcessor/ ) I was startled to find it showing the wrong version of TVAP. I had to refresh my browser to get the correct version to show. Don't know what would happen if I tried to download the wrong version, since it actually wasn't there -- I had deleted it when I uploaded the newer version.

[dlflannery]

No enhancements this time -- fixed a bug that occured if you configured moving .TiVo files to a destination folder.

[dlflannery]

Now automatically corrects the folder location in a .vprj file created by Ad Scan without auto-cut. Explanation: If you have TVAP move the Ad Scan input file to another directory when completed, then the .vprj file is not correct and you can't open it in VRD -- UNLESS you change the folder location in the .vprj file (third line) to point to where you moved the input file -- which is what TVAP now does!

[dlflannery]

TVAP will now output DVR-MS files. MetaData transfer is still on the TO DO list.

The problem with QSF+AdScan w/ AutoCut for DVR-MS output was resolved.

[dlflannery]

TVAP runs .vbs script files using the VRD COM interface.

Sometimes I remote desktop into my computer running TVAP (to view progress, change settings, etc.) then disconnect (not log out, which would stop TVAP completely). After this disconnect, although TVAP keeps running, VRD throws an error when my AdScan.vbs file attempts to open a file with FileOpen(). A VRD message box saying "Unable to play video: Error opening direct sound audio device" is displayed (although I'm running the silent COM interface).

This only happens for FileOpen(). My QSF script uses FileOpenBatch() and it has no problems under the same conditions.

I reinstalled the latest DirectX (9c) runtime just in case -- no change.

I just had to install a fresh system battery in this computer and I'm not sure if this just started happening after this or not. The DirectX diagnostic tool says Direct Sound is working OK.

Anyone have any ideas?

Info: Using VRD 2.5.6.512, running XP SP2

[dlflannery]

TVAP runs .vbs script files using the VRD COM interface.

Sometimes I remote desktop into my computer running TVAP (to view progress, change settings, etc.) then disconnect (not log out, which would stop TVAP completely). After this disconnect, although TVAP keeps running, VRD throws an error when my AdScan.vbs file attempts to open a file with FileOpen(). A VRD message box saying "Unable to play video: Error opening direct sound audio device" is displayed (although I'm running the silent COM interface).

This only happens for FileOpen(). My QSF script uses FileOpenBatch() and it has no problems under the same conditions.

.........
It's the audio settings in the Remote Desktop options -- specifically in the "Local Resources Tab", set the "Remote Computer Sound" to "Leave at Remote Computer". (The "Bring to this Computer" setting causes the problem.) I will add this to the documentation.

[dlflannery]

Two major enhancements:

1. Reads metadata from TiVo files. (Title, Subtitle, Description, Genre and Recording Time/Date for now.) You can see it by right-clicking on a file name and it is automatically inserted into DVR-MS output files.

2. Comes in a Windows installer package now.

Thanks to Dan203 for the ActiveX component (TivoMetaDecode.ocx) that reads the metadata from the TiVo files.

Note: The metadata is read when the tivo file is initially detected by TVAP and is stored in its XML file. This means the XML format changed and your previous XML files will be invalid so TVAP will force a cold startup where you have to set your default options and destination directories. It will also ask you to enter your MAK since that is needed to read the TiVo metadata. (See readme for more details.)
The MAK is also stored in the XML file which is another reason your current XML file is invalid and a cold start is needed (sorry!)

ftp://upload:upload@videoredo.net/VRD%20Add-Ons/TiVo-VideoReDo-AutoProcessor/

[Dan203]

FYI I wrote that metadata control on my own free time, and not as an employee of VideoReDo. Unfortunately, due to legal reasons, we will never be able to add such capabilities directly to VRD.

However, in addition to being a VRD employee I am also a TiVo fan (actually I'm a moderator over on the TC forum) so when I found out tivodecode added the ability to decrypt the metadata I started playing with ways to use it. Unfortunately I got sidetracked by real work and never actually did much with it. But when I saw what dlflannery was doing, and saw a way for him to take advantage of my work, I threw my simple code into an ActiveX control and sent it over to him. He's done the rest and made it actually do something useful. :)

Dan

[dlflannery]

See this post on the TiVoCommunity forum (http://www.tivocommunity.com/tivo-vb/showthread.php?p=5431034&&#post5431034)for the details!

Continued thanks to the VRD guys for allowing the program to be hosted on their ftp site.

ftp://upload:upload@videoredo.net/VRD%20Add-Ons/TiVo-VideoReDo-AutoProcessor/

[dlflannery]

- Fixed: When TivoToGo (at least Ver. 2.3 that I use) queues multiple tivo files for transfer, it creates zero-length files on the tivo transfer directory and TVAP decided the files had completed transferring because their length was not changing.

- Fixed: MetaData for files being transferred was not handled properly.

Download or view readme instructions/details at:
ftp://upload:upload@videoredo.net/VRD%20Add-Ons/TiVo-VideoReDo-AutoProcessor/

[dlflannery]

16 October 2007 Ver. 0.41
- TiVo files "queued" for transfer by Desktop (i.e., sitting on transfer folder with constant zero size)
are shown as TRANSFERRING in the file list, with "queued" displayed for file length. This allows
user to set custom processing options.

[dlflannery]

If you have TVSuite installed, the Run VideoReDo button will launch it, even if you also have VRD-Plus installed.

Regarding the TVAP VRD COM interface, if you have both Plus and TVSuite installed, TVAP uses the COM interface from whichever program was last run with the normal GUI interface. I haven't figured out why but it doesn't seem to make a practical difference as the COM functionality used by TVAP seems to run identically in either case.

[dlflannery]

With Beta 544 of TVSuite, TVAP Ad Detective scans would crash VRD. This appears to be fixed in Beta 545.

[dlflannery]

Enhanced metadata display: Added Movie Year and Episode # (when available). Also, sub-title has been relabeled to: Episode Name.

[dlflannery]

Minor GUI fixes:
1. No longer can resize TVAP form window.
2. Cannot tab focus into the read-only folder edit boxes.

[dlflannery]

See this post (http://www.tivocommunity.com/tivo-vb/showthread.php?p=5724940#post5724940)for details.

[jnhahm]

I found your program night and wonder why it took me so long to find it! A question I have is when running VRD manually and saving to .tivo file it keeps the metadata info and I can see it from the Tivo. When the processing is done with TVAP, I get an error at the end of the Ad scan process saying "Cant transfer Metadata to "name of file.vprj"
I am using Tivo Desktop 2.5, VRD 2.5.3.500, and TVAP v0.48
Any help would be greatly appreciated
Thanks in advance

[dlflannery]

I found your program night and wonder why it took me so long to find it! A question I have is when running VRD manually and saving to .tivo file it keeps the metadata info and I can see it from the Tivo. When the processing is done with TVAP, I get an error at the end of the Ad scan process saying "Cant transfer Metadata to "name of file.vprj"
I am using Tivo Desktop 2.5, VRD 2.5.3.500, and TVAP v0.48
Any help would be greatly appreciated
Thanks in advance
That message isn't an error message, just a statement of fact. I agree it is confusing and will change it in a future release. Here is how metadata is handled by TVAP:

First the metadata is read from the .TiVo file as soon as the file is completely transferred and is saved with other file data in the .xml file.

For .TiVo outputs, the metadata is automatically inserted in the output file by VRD so TVAP doesn't have to do anything.

For DVR-MS output files, a small subset of metadata is inserted in the output file by TVAP.

For mpeg2 outputs or .vprj outputs, TVAP generates a separate text file containing metadata in a format useable by pyTiVo transcoding server (http://pytivo.armooo.net/) as described in this post (http://www.tivocommunity.com/tivo-vb/showthread.php?p=5724940#post5724940).

The message just states the fact that metadata cannot be inserted by TVAP into the output file except for DVR-MS.

[jnhahm]

Ok, That makes sense since the .tivo file i was processing had already been transfered before i had installed TVAP. Thanks for your quick reply and thanks to all who have supported this program.

[dlflannery]

From change log:

18 December 2007 Ver. 0.49
- Added "showingBits" field to pyTivo medadata text file
- Killed confusing log message about unable to add metadata.
- Added automatic running of user-furnished post-processing batch file.

TVAP will run a batch file of your creation after processing each .mpg file.

-- For mpeg2 outputs, if you place a batch file named TVAPpostProcess.bat or TVAPpostProcess.cmd in the final destination directory TVAP will run the batch file upon completion of VRD processing of each file output to that folder..

The filename WITHOUT the .mpg extension and without the path is passed as the argument to this batch file. No configuration is necessary -- if the batch file is there it will be run.

Regarding this optional user post-process batch file (TVAPpostProcess.cmd):
a.) TVAP just starts the batch and waits for it to complete.
b.) It runs in the final destination folder where it is located.
c.) TVAP has no way to know whether it completed successfully or what it did.
d.) Thus the user is responsible for making the batch file work and not crash or
hang up. And also for not spawning dangling processes that keep on running
after the batch file has exited (unless you REALLY know what you're doing!).
e.) Here is a sample batch file that shows how to add the .mpg extension to
the passed file name and verify the existence of the .mpg file:
@echo off
setlocal
set mpgName="%~1.mpg"
echo batch file : mpgName is %mpgName%
if exist %mpgName% echo file exists!
pause

[linfor]

Is there anyway to get the functionality of this application using it just on mpg files. I am looking for just such a program but for mpgs and not tivo files.

[dlflannery]

Is there anyway to get the functionality of this application using it just on mpg files. I am looking for just such a program but for mpgs and not tivo files.
This would require a major code mod. I'm curious as to your application. You have a situation where mpg's are being transferred into a folder? If there were a number of OP with the same need, I would consider doing it.

[linfor]

This would require a major code mod. I'm curious as to your application. You have a situation where mpg's are being transferred into a folder? If there were a number of OP with the same need, I would consider doing it.

I have recordings done daily. I run quick stream fix on them and then move the originals to a folder. The fixed should be then moved to another folder and adscan run on them and the vprj file created. I have to manually check the files because they are foreign language shows and they do not always have black screen transitions to commercials or before the show start. Plus the programs always start late.
I want to then if possible auto batch the files and run videoredo to cut out the commercials. At that point I want to batch the files again and send them to a script that works with mencoder to convert them to avi.
I know nothing about this stuff and what I have so far I gleaned from the forum and from testing eternally.
1) Run quickstream fix - done
2) move stream fixed files to folder \scanned - done
3) move originals to folder \raws - done
4)Run adscan on files in \scanned folder - having problems figuring out how to tell it to look in \scanned folder

After that step is done and I check the cuts I would like to have a small batch file that will send all the vprj files in that folder to be edited to remove the commercials without me having to manually batch each file. Then I want to send those mpgs to mencoder to be encoded to avi and all the files sed in processing moved to a directory called \processed
I am sure others would find it useful to have all this automated or semi automated.

[sward]

I have recordings done daily. I run quick stream fix on them and then move the originals to a folder. The fixed should be then moved to another folder and adscan run on them and the vprj file created. I have to manually check the files because they are foreign language shows and they do not always have black screen transitions to commercials or before the show start. Plus the programs always start late.
I want to then if possible auto batch the files and run videoredo to cut out the commercials. At that point I want to batch the files again and send them to a script that works with mencoder to convert them to avi.
I know nothing about this stuff and what I have so far I gleaned from the forum and from testing eternally.
1) Run quickstream fix - done
2) move stream fixed files to folder \scanned - done
3) move originals to folder \raws - done
4)Run adscan on files in \scanned folder - having problems figuring out how to tell it to look in \scanned folder

After that step is done and I check the cuts I would like to have a small batch file that will send all the vprj files in that folder to be edited to remove the commercials without me having to manually batch each file. Then I want to send those mpgs to mencoder to be encoded to avi and all the files sed in processing moved to a directory called \processed
I am sure others would find it useful to have all this automated or semi automated.

I don't use Tivo, but I have similar needs and it looks like TVAP could address them all if (1) it didn't require Tivo Desktop, and (2) you could input *.mpg or *.tp files.

[dlflannery]

I have recordings done daily. I run quick stream fix on them and then move the originals to a folder. The fixed should be then moved to another folder and adscan run on them and the vprj file created. I have to manually check the files because they are foreign language shows and they do not always have black screen transitions to commercials or before the show start. Plus the programs always start late.
I want to then if possible auto batch the files and run videoredo to cut out the commercials. At that point I want to batch the files again and send them to a script that works with mencoder to convert them to avi.
I know nothing about this stuff and what I have so far I gleaned from the forum and from testing eternally.
1) Run quickstream fix - done
2) move stream fixed files to folder \scanned - done
3) move originals to folder \raws - done
4)Run adscan on files in \scanned folder - having problems figuring out how to tell it to look in \scanned folder

After that step is done and I check the cuts I would like to have a small batch file that will send all the vprj files in that folder to be edited to remove the commercials without me having to manually batch each file. Then I want to send those mpgs to mencoder to be encoded to avi and all the files sed in processing moved to a directory called \processed
I am sure others would find it useful to have all this automated or semi automated.
I have an idea for a mod to TVAP that I think would do this for you:

Use TVAP as currently to automatically QSF and AdScan (without autocuts), thus creating a .vprj file in your scanned folder.

TVAP would remember the .vprj file name and time/date stamp (via data in its xml file).

Then you manually review the edit cuts and save the .vprj file (with the same name).

TVAP will be looking for a change in the time/date stamp (to later) of that .vprj file and when it sees it, will perform the autocut (using your modified edits) creating a final .mpg file.

Then TVAP would run the "user supplied" batch file (the feature just added in Ver. 0.49), which could be your mencoder AVI creation file. TVAP would give priority to "finishing" files this way compared to processing newly transferred file, i.e., only one VRD or mencoder process would be running at one time.
(I believe this is advisable rather than sharing the processor over multiple encoding processes.)

This would entirely automate your process (and mine too!), and you just do the manual edit reviews whenever you want.

How does that sound?

[msmart]

Oooh, I like where you're going with this.

1. I use TVAP to QSF the TiVo file to a new folder.
2. I use DirMon2 to run comskip producing a .vprj file
3. I review/edit cuts saving .vprj with same name

If you could get TVAP to do as you say:TVAP will be looking for a change in the time/date stamp (to later) of that .vprj file and when it sees it, will perform the autocut (using your modified edits) creating a final .mpg file.that would be sweet.

Right now I repeat step 3 until finished with files, then add the .vprj files to VRD's Batch Manager and let it go. But having TVAP look for the updated .vprj file would be a nice addition.

[linfor]

I have an idea for a mod to TVAP that I think would do this for you:

Use TVAP as currently to automatically QSF and AdScan (without autocuts), thus creating a .vprj file in your scanned folder.

TVAP would remember the .vprj file name and time/date stamp (via data in its xml file).

Then you manually review the edit cuts and save the .vprj file (with the same name).

TVAP will be looking for a change in the time/date stamp (to later) of that .vprj file and when it sees it, will perform the autocut (using your modified edits) creating a final .mpg file.

Then TVAP would run the "user supplied" batch file (the feature just added in Ver. 0.49), which could be your mencoder AVI creation file. TVAP would give priority to "finishing" files this way compared to processing newly transferred file, i.e., only one VRD or mencoder process would be running at one time.
(I believe this is advisable rather than sharing the processor over multiple encoding processes.)

This would entirely automate your process (and mine too!), and you just do the manual edit reviews whenever you want.

How does that sound?

That sounds great. I would be only too happy to be a guinea pig for this. I know nothing about scripts and all that and I spend so many hours experimenting that I end up confusing myself.
It would be good if we can have mencoder and videoredo use low amount of cpu so that it does not take away proicessing power when a show is being recorded. I use gbpvr for recording and if mencoder runs while recording is going on the recorded show is jumpy and has lots of problems

[dlflannery]

Use TVAP as before to automatically QSF and AdScan (without autocuts), thus creating a .vprj file in your AdScan destination folder.

TVAP remembers the .vprj file name and time/date stamp (via data in its xml file).

Then you manually review the edit cuts and save the .vprj file (with the same name in the same place).

TVAP detects the change in the time/date stamp (to later) of that .vprj file and then commands VRD to perform the autocut (using your modified edits) creating the final output file (in the AdScan destination folder).

Then TVAP will run the "user supplied" batch file (the feature just added in Ver. 0.49), if it ("TVAPpostProcess.cmd") is present in the AdScan destination folder AND if the file extension of the final-edited file is .mpg.

If desired you can do all this from within TVAP. After creating the .vprj file(s), stop processing and run GUI VRD to load and review the cuts. Then when you restart processing the auto-generation of the output file with your modified edits will occur.

If you don't want to use the post-batch file for re-encoding to MPEG4 you could just use it to transfer completed files to another folder and/or delete the .vprj files.

This will entirely automate your process (and mine too!), and you just do the manual edit reviews whenever you want.

This was a complicated mod so there may be bugs. Please let me know. I've left the previous version on the download site so you can revert to it if necessary.

[linfor]

Several things
1)If the original file is not a .tivo the program will not see it to start the process
2) Can you put an option in the settings that would allow the user to preset the program to stop any processing after the adscan and another button to start the cutting - like "continue processing". This would help to automate further so that the user would not have to monitor to see when the processing has reached the adscan stage. If you select the stop after VRD it stops after the QSF stage and then has problems locating the file if you want to continue from there.
3) How do I tell it that after it has done the auto cuts to go and do the batch file for the encoding by mencoder. I have that batch file in the adscan directory along with the TVAPpostProcess.cmd

[dlflannery]

26 December 2007 Ver. 0.51
- Removed "_QSF" from .vprj file names.
- Tightened logic determining when user post-process batch is run.

[dlflannery]

Several things
1)If the original file is not a .tivo the program will not see it to start the process

Having it look for other file types than .tivo would really complicate the program logic. I will have to ponder that.

2) Can you put an option in the settings that would allow the user to preset the program to stop any processing after the adscan and another button to start the cutting - like "continue processing". This would help to automate further so that the user would not have to monitor to see when the processing has reached the adscan stage. If you select the stop after VRD it stops after the QSF stage and then has problems locating the file if you want to continue from there.

If you configure to do QSF then AdScan w/o cuts (or just AdScan w/o cuts), the program will stop doing anything when it completes generating all the .vprj files. It will not run the user batch file or create the final edited file at that point.

Then if you run VRD to manually verify/modifiy the cuts (by loading the .vprj file then saving to the same location and name when done), TVAP will see the new time stamp on the .vrpj files and willl automatically apply your cuts to generate the final output file. At that point it will run the TVAPpostProcess.cmd with the video file name (without path or extension) as the single argument.

3) How do I tell it that after it has done the auto cuts to go and do the batch file for the encoding by mencoder. I have that batch file in the adscan directory along with the TVAPpostProcess.cmd
You have to use TVAPpostProcess.cmd (or .bat) to do this, either by having it "call" your batch file or by incorporating your batch file into one called TVAPpostProcess.cmd. If you need help creating the batch file(s), could you post or attach your mencoder batch file?

[msmart]

I have a question about where files end up when using QSF and Ad Scan together (without Auto Cut) and using the Delete TiVos option.

When selecting the Do QSF, Do Ad Scan and Delete TiVos options, I think the QSF process runs first and places the mpeg2 file in the QSF Destination folder and deletes the file from the TiVo Transfers folder. Then Ad Scan (without Auto Cut) is run placing a .vprj file in the Ad Scan Destination folder. Am I correct so far?

Then if I update the .vprj file manually and save it, TVAP will run VRD to create a new mpeg2 file without commercials. Where does this file end up? In the Ad Scan Destination folder?

I would also need to manually delete the QSF file from the QSF Destination folder, correct? If so, I think I want it to be this way, just in case something happens, I still have a file to fall back to.

[msmart]

Well, I guess I should have just tried it rather than asking the questions above.

I have to say, this new feature of starting auto cuts after manually editing the .vprj file is VERY COOL!!!!! THANK YOU!!!

Here's what I found how it works:

1) TiVo Desktop transfer completes
2) TVAP starts QSF saving file to QSF Destination folder
3) TVAP deletes file from TiVo Transfers folder
4) TVAP starts Ad Scan saving .vprj file in Ad Scan Destination Folder
5) [When you are ready,] launch VideoReDo to review/edit .vprj project file
6) Save project (Ctrl+P)
7) TVAP starts auto cuts saving file without commercials in Ad Scan Destination folder
8) File in QSF Destination folder remains (manually delete when you are ready)

This is beautiful. Did I say thank you already? If not Thank You!!! ;)

This was a complicated mod so there may be bugs. Please let me know.I've only done two 30 min files so far, it worked as advertised, I didn't find any bugs. I'd say TVAP is ready for "prime time" as they say. Well done.

[dlflannery]

I have a question about where files end up when using QSF and Ad Scan together (without Auto Cut) and using the Delete TiVos option.

When selecting the Do QSF, Do Ad Scan and Delete TiVos options, I think the QSF process runs first and places the mpeg2 file in the QSF Destination folder and deletes the file from the TiVo Transfers folder. Then Ad Scan (without Auto Cut) is run placing a .vprj file in the Ad Scan Destination folder. Am I correct so far?

Then if I update the .vprj file manually and save it, TVAP will run VRD to create a new mpeg2 file without commercials. Where does this file end up? In the Ad Scan Destination folder?

I would also need to manually delete the QSF file from the QSF Destination folder, correct? If so, I think I want it to be this way, just in case something happens, I still have a file to fall back to.
All your assumptions are correct. The TVAPpostProcess.cmd batch file could be used to move and/or delete files if desired.

[linfor]

You have to use TVAPpostProcess.cmd (or .bat) to do this, either by having it "call" your batch file or by incorporating your batch file into one called TVAPpostProcess.cmd. If you need help creating the batch file(s), could you post or attach your mencoder batch file?

Here it is

[dlflannery]

linfor:
I assume this is a .bat or .cmd and you changed the extension in order to attach it, correct?

Try creating a TVAPpostProcess.cmd file (in your adscan output folder along with the transcode.bat or transcode.cmd file) containing the following:

@echo off
setlocal

REM Insert the folder path where this batch is running.
REM Be sure to include the final backslash ('\')
REM Do NOT enclose in quotes.

set localDir=C:\my adscan folder path\

REM May need to subsitute extension .cmd for .bat in next line.
call transcode.bat "%localDir%%~1.mpg"

Be sure to use your adscan folder path and set the proper extension for transcode.xxx batch.

[TivoTodd]

dlflannery:
Well done! Nice little app.
Following msmart's 8 simple steps to auto-processing heaven (a few posts back) works great.

I do have a question though. What are the proper setttings in TVAP if you just want to take newly transferred TiVo files, pass it through VideoReDo with no QSF, no Ad-Scan, so we simply have a .mpg file in a new location instead of the .tivo file in the "my recordings" location.

I tried simply setting the "Delete TiVos" in Default settings. I got an error indicating "Error deleting .TiVo file: <program name>"

I tried stopping the processing, resetting the status, and then starting the process, and it deleted the file immediately. But it never to process it through VideoRedo.

Are there proper setttings in TVAP to do this?

[linfor]

I really like this program. I use it several times a day and it makes life easier. With about 10 hours of recordings daily it is GREAT!! Thanks a lot for creating it.
Is there anyway to call another program to run after the cutting of the commercials? I want to call ccextractor or mpg2srt to create subtitle files after the ads are removed from the show

[dlflannery]

I really like this program. I use it several times a day and it makes life easier. With about 10 hours of recordings daily it is GREAT!! Thanks a lot for creating it.
Is there anyway to call another program to run after the cutting of the commercials? I want to call ccextractor or mpg2srt to create subtitle files after the ads are removed from the show
Yes, as long as it has a command line interface (i.e., doesn't require you to start a GUI to run it). All you do is call it from the TVAPpostProcess.cmd batch file with a line like this:

call <programPath> <arg1> <arg2> ....

The only catch is that only one argument has been passed into TVAPpostProcess.cmd, which is the "bare" video file name (without path or extension). Thus all the arguments passed to the program you call must either be pre-determined constants or constructable knowing only the bare video name.

You can put as many of these as you wish in there.

Speaking of this, did you see my post #39 to you? Did it work?

[dlflannery]

dlflannery:
Well done! Nice little app.
Following msmart's 8 simple steps to auto-processing heaven (a few posts back) works great.

I do have a question though. What are the proper setttings in TVAP if you just want to take newly transferred TiVo files, pass it through VideoReDo with no QSF, no Ad-Scan, so we simply have a .mpg file in a new location instead of the .tivo file in the "my recordings" location.

I tried simply setting the "Delete TiVos" in Default settings. I got an error indicating "Error deleting .TiVo file: <program name>"

I tried stopping the processing, resetting the status, and then starting the process, and it deleted the file immediately. But it never to process it through VideoRedo.

Are there proper setttings in TVAP to do this?
Just set it up to do only the QSF function. This is basically equivalent to just loading it into VRD as a .TiVo then saving as a .mpg. (VRD does most of the QSF clean up in that case anyway, and there is no significant processing time difference.) The delete .TiVo thing should function properly then.

[dlflannery]

Here is the MediaFire link (http://www.mediafire.com/download.php?ahmwxllmxmf) to a zip package containing the batch file and instructions.

Users are welcome to try this TVAPpostProcess.cmd file. You need to have AviSynth, dgIndex and ffmpeg (all free). Here is what it's about:

This batch produces xvid/avi files and uses dgindex and avisynth to feed a .avs stream into ffmpeg. You could of course feed the mpeg2 directly into ffmpeg. The .avs method allows an autocrop, i.e., if the video is a movie with 2.35:1 aspect it will automatically crop and produce a 640x272 output instead of 640x480. This allows faster and more efficient processing for encoding (and for pyTivo transcoding later). You can do this cropping manually with ffmpeg arguments also but you would have to manually configure it for each video. The .avs method also provides more sophisticated handling of interlacing and field order.

Start with the BatchNotes.txt file. A package of the required AviSynth plugins is also included, which saves a lot of searching and downloading time.
All you need to do is download and install dgIndex, AviSynth and ffmpeg, copy the AVS plugins to the correct folder, and edit the folder path variables in the batch file following the remarks provided. Instructions for testing the batch outside TVAP are also included.

[dlflannery]

- Increased time interval .TiVo file must have constant size to be declared "done transferring" from 5 seconds to 15 seconds. This is to reduce possible problem experienced by one user when his TiVo box was busy doing other things and DeskTop failed to transfer any bytes during a five second interval -- and TVAP decided the file was done transferring. Note this required increasing the startup delay time from 7 seconds to 18 seconds.

- Added starRating, mpaaRating and tvRating to metadata file.

Follow link in my signature to get download link.

[TivoTodd]

Is there a setting to cause VideoRedo to use "Enable Filters" with a specific resolution?

Certain shows recorded from SciFi (Stargate series, so far) won't pass through an Ad-Scan unless you QF with filters enabled. The recorded show apparenlty has a section of commericals that is at a different resolution (352x480) than the rest of the show and commercials (544x480).

During Ad-Scan, TVAP (or perhaps it is the VRD background process) pops up a dialog box reporting the error (<title>MovieWindow Problem, <text> Video Thread: Video Dimensions changed), and halts there until you press OK. Once you do, TVAP saves a .vprj file for the show with nothing in it, deletes the .tivo file (if selected) and attempts the QF on the next show. This problem pretty much kills any unattended processing.

My current workaround is to use VRD to open the QF file, QF the file again with filters enabled(save it to an (02) filename). Some times I have to change the "Samples" value, and rescan to get the "bad" resolution to show up. Select the proper resolution, and then save the new QF (02).
After that QF is saved, I delete the original QF, rename the (02) to the original name, and open VRD again to start the Ad-Scan, perform edits, and save it over the .vrpj file in the Ad Scan destination. And TVAP takes off from there.

So.. feature enhancement, or just live with it? I don't know how you can code for something like that and have it work with all shows... perhaps do the filter scan (samples value of 128 usually works) and select the highest resolution for the QF? Or, perpaps watch for the error, and create a new status that indicates manual processing is needed, or something.

This one's a doosey!

I am on Cox cable, if anyone is interested in seeing if they do or don't have that same problem.

[dlflannery]

Is there a setting to cause VideoRedo to use "Enable Filters" with a specific resolution?

Certain shows recorded from SciFi (Stargate series, so far) won't pass through an Ad-Scan unless you QF with filters enabled. The recorded show apparenlty has a section of commericals that is at a different resolution (352x480) than the rest of the show and commercials (544x480).

During Ad-Scan, TVAP (or perhaps it is the VRD background process) pops up a dialog box reporting the error (<title>MovieWindow Problem, <text> Video Thread: Video Dimensions changed), and halts there until you press OK. Once you do, TVAP saves a .vprj file for the show with nothing in it, deletes the .tivo file (if selected) and attempts the QF on the next show. This problem pretty much kills any unattended processing.
...........
So.. feature enhancement, or just live with it?.
Do you have VRD TVSuite?

With VRD Plus there was no way to control the QSF filter size via the COM interface (which is what TVAP uses). However I searched the forum for "filter" in response to your post and found these posts (http://www.videoredo.net/msgBoard/showthread.php?t=5989&highlight=filter) which say this control has been added to VRD TVSuite, and indeed it does show up in the help for it..

If you're interested I could give you modified .vbs script files (which are used by TVAP) with this filter hard coded to 544x480. You would sub these for the ones distributed with TVAP (temporarily, saving the originals of course).

You have to have TVSuite for this although you could free-trial it long enough for these tests.

[msmart]

Will TVAP remember to auto-cut shows that have been QSF'd and scanned if I stop processing, close TVAP, install the latest version and start it up?

[TivoTodd]

Do you have VRD TVSuite?

With VRD Plus there was no way to control the QSF filter size via the COM interface (which is what TVAP uses). However I searched the forum for "filter" in response to your post and found these posts (http://www.videoredo.net/msgBoard/showthread.php?t=5989&highlight=filter) which say this control has been added to VRD TVSuite, and indeed it does show up in the help for it..

If you're interested I could ......

Nope.. plain old VRD here. It sounds like the your fix would have to be remembered everytime I updated to the latest version, or I would write over your .vbs scripts. I will keep doing what I am doing, for now. Perhaps SciFi, or my local Cox broadcaster will stop monkeying with the resolution.. /rude Cox!

Thanks again, dlf!

[dlflannery]

Nope.. plain old VRD here. It sounds like the your fix would have to be remembered everytime I updated to the latest version, or I would write over your .vbs scripts. I will keep doing what I am doing, for now. Perhaps SciFi, or my local Cox broadcaster will stop monkeying with the resolution.. /rude Cox!

Thanks again, dlf!
If the test worked and you are willing to spring for TVSuite, we could figure out something so you didn't have to worry about the scripts, for example a command line option such as /f that you would just edit into the TVAP shortcut properties, which would invoke the filter. Let me know if you want to test it.

[dlflannery]

Will TVAP remember to auto-cut shows that have been QSF'd and scanned if I stop processing, close TVAP, install the latest version and start it up?
For a new version with the same XML data file format there would be no problem. But typically new versions do involve additions to the XML format, e.g., for tvRating.

However the workaround is easy.

1. Save off a copy of the TivoFileManager.xml file before installing the new version.
2. Uninstall the old version and Install the new version.
3. Run it, reconfigure if needed, then shut it down.
4. Using notepad, look in the new XML file and the old one you saved. The memory of .vprj files to be processed is near the bottom in sections bracketed by <AutoCuts> and </AutoCuts>. I don't know whether the autocut data will have survived in the new XML or not but if you just copy it from the old XML and paste it into the new one in the same location, that should do the trick.

As long as you saved the old XML file, there are other tricks to be tried if this one didn't work.

[msmart]

Yes, that does sound easy. I didn't have as many shows waiting for me to edit (the .vprj file) as I thought so I just manually edited them, when auto-cuts finished downloaded .52.

On to my next quest.... now that you've given us metadata txt files, I've got an accumulation of them waiting for me to extract the seriesTitle, episodeTitle, and description to place into a spreadsheet I maintain listing shows I've downloaded and burned to DVD.

I used to use TiVoPlayList to export the entire playlist to a file and parse into columns in the spreadsheet. However, all shows in the playlist were exported so I would have to delete the shows I didn't download (over and over again.)

Now, with TVAP, I get the metadata information just for the shows I download and process with TVAP. A time saver I think, but that leads me to my problem, how to I get the 3 data elements I want from the individual files into my spreadsheet?

I re-read through the TVAP thread over at tivocommunity and saw where someone had written some sort of script that would get the data from the metadata files. There was a request to have it posted but it wasn't.

Any suggestions on how to do it faster than a copy/paste method?

[dlflannery]

If you ever cared about what priority VRD was running at under TVAP, take a look at this portion of the TVAP thread on TivoCommunity forum (http://www.tivocommunity.com/tivo-vb/showthread.php?p=5888073#post5888073).

If you have opinions on the need to run at lower priority or to set priority, say with a command line switch (edited into your shortcut), chime in.

[dlflannery]

- Added command line option -p<#> to set priority of VRD processes.
0 = low, 1 = below normal, 2 = normal. TVAP defaults to below normal

- Added logic to prevent any possibility of writing empty DisplayMajorNumber item to pyTivo metadata file.

TVAP should only set the priority of the VRD processes it is controlling.

To add the CL arg to a shortcut, add it after the program path in the shortcut properties, target entry. Do not add it inside the quotation marks and do put a space between it and what is already there.

Note: An example CL arg is: -p1
There should be no space between the -p and the number.

The priority-setting feature has not been tested on Vista. If you have admin privileges it probably will work fine. Otherwise there are several possibilities:

1. It will still work fine.
2. It won't complain but just won't set priority.
3. It will bring up a message of some kind.

Let me know what you observe. You can see priority in Task Manager by configuring the Base Priority column in its process display.

I have seen three different process names for VRD:

videoredo3.exe
videoredo.exe
VIDEOR~1.exe (name mangling for DOS 8.3 filenames ??)

My computer just suddenly starting using the third one instead of the second one for no apparent reason at all. I think TVAP will handle it OK.

[msmart]

Color me stupid, but were exactly do I change the priority? It's not making sense to me.

I have XP Home and use Process Explorer (http://technet.microsoft.com/en-us/sysinternals/bb896653.aspx) rather than Task Manager. Using it to change priority, you're given the following choices 4=Idle, 6=Below Normal, 8=Normal, 10=Above Normal, 13=High, 24=Realtime.

After installing .53 I see that VRD (that TVAP launches) now defaults to 6 as expected. So if 1=below normal, and 0=Low, wouldn't 0 actually equal Idle in my case?

But again, were do I change it from 1 to 0?

[dlflannery]

Color me stupid, but were exactly do I change the priority? It's not making sense to me.

I have XP Home and use Process Explorer (http://technet.microsoft.com/en-us/sysinternals/bb896653.aspx) rather than Task Manager. Using it to change priority, you're given the following choices 4=Idle, 6=Below Normal, 8=Normal, 10=Above Normal, 13=High, 24=Realtime.

After installing .53 I see that VRD (that TVAP launches) now defaults to 6 as expected. So if 1=below normal, and 0=Low, wouldn't 0 actually equal Idle in my case?

But again, were do I change it from 1 to 0?
AFAIK idle = low

It's a command line argument.
Right click on TVAP shortcut.
Select properties
Edit the "Target" field.
It should contain something like:

"C:\Program Files\TVAP\TiVo-VideoReDo-AutoProcessor.exe"

Add a space after the last quote then add -p0 so you now have:

"C:\Program Files\TVAP\TiVo-VideoReDo-AutoProcessor.exe" -p0

The 0 is the numeral 0 not the letter O.

[dlflannery]

29 January 2008 Ver. 0.54
- Added Do post-process check box to per-file settings. Defaults to checked.
If checked, optional user-supplied TVAPpostProcess.cmd file will be run on
the completed mpeg2 file.

Now you can control which files are post-processed. If you don't have a post-process batch file in place, nothing will happen and it doesn't matter whether the new check box is checked.

For download follow TVAP link in my signature below.

[dlflannery]

4 February 2008 Ver. 0.55
- Fixed: Always ran user-supplied TVAPpostProcess.cmd file after manual review of .vprj file, ignoring Do post process checkbox setting.

And thanks to msmart for calling this to my attention!

[dlflannery]

5 February 2008 Ver. 0.56
- If your TVAPpostProcess.cmd uses Handbrake (hbcli.exe), its priority will be set to the same level as VRD processes, per the TVAP -p# command line option. (See Ver. 0.53 info in TVAPreadme.txt for priority setting.)
Note side effect: Any other instances of hbcli.exe running when your batch starts will also be set to this priority.

- Installer no longer removes Desktop shortcut on uninstall, and upon installation offers "Don't create a start menu folder" option which, if checked will not create a new shortcut -- thus preserving any -p# option you had edited into the shortcut target line.
Side effect: The start menu entry is also not created if this option is checked.

Note you can delete any shortcut by selecting it and hitting Shift-Del (in case you uninstall TVAP and want to get rid of the shortcut).

[dlflannery]

If you've wondered when and whether to use QSF with TVAP, take a look at this thread (http://www.videoredo.net/msgBoard/showthread.php?t=6163).

[dlflannery]

24 February 2008 Ver. 0.57
- Handles process priority setting of new Ver. 0.9.2 Handbrake CLI executable name ("HandBrakeCLI.exe") in user TVAPpostProcess.cmd batch file. Continues to handle old executable name ("hbcli.exe").

Reminder: You can download a TVAPpostProcess.cmd file that uses HandBrake to create xvid/avi encodings of your VRD-processed mpeg2 files at this mediafire.com link (http://www.mediafire.com/download.php?8wf9tdbtfmq). On an initial test, it appears to work as-is with the new HandBrake CLI version, if you edit in the right .exe name.

[dlflannery]

- Files waiting for manual editing/cuts now remain on the file list, even if the TiVo file
has been deleted. The Status for these is "AWAITING CUTS". This allows you to change the
Do Postprocess and Delete QSF settings for the file.
If the Tivo file is gone and you click the Reset button, you get a dialog offering to
let you remove the file from the list -- which will also mean it is no longer waiting for
manual editing/cuts.

- Two delete QSF buttons: Default Settings and per-file. If your process includes QSF followed
by AdScan (with or without autocuts), the intermediate QSF file will be deleted after all
processing on the file is done -- including manual cuts and post-process batch file.

Since this change added new elements to the XML data file, you will get the initial startup message about can't find a valid file. You can avoid this with some editing work on the file:

1. Add this line:

<DeleteQsfFiles>true</DeleteQsfFiles>

Anywhere in the <ConfigurationItems> section.

2. Add this line:

<DeleteQSF>true</DeleteQSF>

anywhere in each <TivoFileData> section.

Of course you can change "true" to "false" per your preferences.


I've done a fair amount of testing but with all the possible combinations of file types, sequences and settings it's not practical to do exhaustive testing. So I won't be surprised if you find a bug or two. Please try to furnish a detailed description if you find one.

[goodtrips]

Do you have VRD TVSuite?

With VRD Plus there was no way to control the QSF filter size via the COM interface (which is what TVAP uses). However I searched the forum for "filter" in response to your post and found these posts which say this control has been added to VRD TVSuite, and indeed it does show up in the help for it..

If you're interested I could give you modified .vbs script files (which are used by TVAP) with this filter hard coded to 544x480. You would sub these for the ones distributed with TVAP (temporarily, saving the originals of course).

You have to have TVSuite for this although you could free-trial it long enough for these tests.

Sorry to bump this topic again, but I never saw any resolution come from the earlier post. I'm having the same issue with TV Suite choking on SD recordings with commercials that have a 352x480 resolution (From a TiVoHD unit).

Adding the command to the VBS file seems simple enough, but because valid recordings can be in multiple dimensions (480i, 720p, 1080i) I am hesitant to hardcode 1 resolution into the command -- it's possible I am just misreading the documentation, however.

Is it possible to add the line so that it the filter only excludes video only with a dimension of 352x480 and allows the rest?

[dlflannery]

Sorry to bump this topic again, but I never saw any resolution come from the earlier post. I'm having the same issue with TV Suite choking on SD recordings with commercials that have a 352x480 resolution (From a TiVoHD unit).

Adding the command to the VBS file seems simple enough, but because valid recordings can be in multiple dimensions (480i, 720p, 1080i) I am hesitant to hardcode 1 resolution into the command -- it's possible I am just misreading the documentation, however.

Is it possible to add the line so that it the filter only excludes video only with a dimension of 352x480 and allows the rest?
I dropped the subject after the only user who showed interest decided not to pursue it.

For a given QSF run VRD can only use one filter size -- there is no capability to include all sizes except a specified one.

It would be possible to add a command-line option (e.g. -f544x480) to TVAP that would cause the filter to be set to the specified size. I suspect this is of little value to you.

There is no automated solution when you have to be able to handle different resolutions for different video files. You have to know or determine the desired filter resolution before starting the VRD QSF process.

I'm limited somewhat on this topic because I don't have a source of multi-resolution files. The thought occurs that there might be a clever VBScript algorithm that would scan a file and determine the "dominant" resolution. If anyone has any info along those lines, let me know. (And I have to get a multi-resolution clip to test on.)

[goodtrips]

As always, dlfl, thanks for your attention. I know this is really a shortcoming of VRD, especially since the marketing material speaks to compatibility specifically with TiVoHD content. I have submitted this as a feature request in the past.

If you have an example VBScript that you have time to post, even if it was to set the filter at a fixed size, I'd be happy to play around with it, although I have my doubts I'm clever enough to pull it off.

Keep up the great work on TVAP! The app is absolutely solid, and I can't begin to tell you how much easier it has made what was a daily, manual task.

[dlflannery]

.................If you have an example VBScript that you have time to post, even if it was to set the filter at a fixed size, I'd be happy to play around with it, although I have my doubts I'm clever enough to pull it off....................
First see this thread (http://www.videoredo.net/msgBoard/showthread.php?t=5989), especially starting at post #3. If VRD provides this COM function, automatic handling of filter dimensions will be possible. I was encouraged by DanR's response.

What I would do is provide you with a "special" replacement version of one of the VBScript files that TVAP uses (doQSF.vbs). The only difference would be adding one line to set the filter dimensions. What dimensions would you like to start with? (You can easily change them with a text editor.) Then you just set up a QSF operation in TVAP.

I want to test this myself first so it might be a day or two. For example I want to find out what happens if you specify a filter size and there is zero content in the video that matches it, i.e., does it throw an error and/or create a zero-length file, or what?

Note this will only work with VRD TVSuite. I also need to find out what happens if you try to set the filter size with VRD plus.

[goodtrips]

Great! So from an hour long recording from MSNBC, I manually doing a filter scan with 128 samples, I found that one recording had all 3 dimensions of:

352x480
528x480
704x480

I'm almost beginning to wonder if I drop the recording quality to Good or Medium (currently on Best) if that would have a more generic analog re-encoding effect where everything would share the same dimensions.

Happy to do some tests on my end as well with the modified VBScript. Thanks again for your help!

[dlflannery]

I'm not having much luck with the SetFilterDimensions COM function so far -- see this post (http://www.videoredo.net/msgBoard/showpost.php?p=36589&postcount=7)for details.

Edit: Working OK now after DanR gave me the secret decoder ring -- see THIS post. (http://www.videoredo.net/msgBoard/showpost.php?p=36593&postcount=9)

So, I've attached the modified QSF.vbs file. Note the SetFilterDimensions statement on line 17. I set the size to 528x480 but obviously you can change it to whatever you want.

This replaces the QSF.vbs file in your TVAP installation folder -- but first be sure to rename the original or save it to a different folder -- just in case. You can disable the filter statement by just inserting "rem " at the beginning of the line.

If you have both VRD Plus and TVSuite on your system, be sure to start up TVSuite briefly just before you run TVAP for these tests. TVAP uses whichever version of VRD you most recently opened manually -- I don't know how to get around this.

[goodtrips]

I've monkeyed around with this before, but I think I was having the same issue you were having with the syntax:

VideoReDo.SetFilterDimensions 352, 480

In the TVAP QSF.vbs script, would this then go at the bottom between

end if
and
videoReDo.close()
?

EDIT: Somehow missed the file you attached in your earlier post (doh). I'll run some tests on my end and let you know how it turns out.

[dlflannery]

I've monkeyed around with this before, but I think I was having the same issue you were having with the syntax:

VideoReDo.SetFilterDimensions 352, 480

In the TVAP QSF.vbs script, would this then go at the bottom between

end if
and
videoReDo.close()
?

No, I think you missed my last edit to my previous post -- I attached the modified script file. I'll be curious to see how this works on truly multi-dimensional files such as you have.

[goodtrips]

So far, have tried the filter with the following dimensions:
352x480
528x480

And it's chugging away currently on:
704x480

So the good news -- the filter command works, and my output after adscan with autocuts are only sequences of commercials in those dimensions. I'm assuming the 704x480 will be the same, but with the show content included this time.

Tonight I will try and run these filters on files that don't contain any of these dimensions (HD) to see what the output is.

[goodtrips]

So far, the filter has successfully worked with these tested dimensions:

352x480
528x480

and predictably, the output file was only the commercials aired during the broadcast that were in these dimensions. it's currently chugging away with 704x480, but i'm pretty confident that will be the main show content.

i had a thought about how to integrate this logic (albeit ungracefully) directly into the QSF vbs file. The user could set up manual if/else statements based upon values in the tivo file name. So it would look something like:

if showname contains "msnbc" set VideoReDo.SetFilterDimensions 704, 480
if showname contains "daily show" VideoReDo.SetFilterDimensions 528, 480
else, no filter

The onus would be on the user to manually determine the dominant dimension of each file and modify the QSF script, but for season pass/auto transfers it would be a set it and forget solution.

...just a thought.

EDIT: Sorry for the double post... original reply was not showing up originally.

[dlflannery]

So far, the filter has successfully worked with these tested dimensions:

352x480
528x480

and predictably, the output file was only the commercials aired during the broadcast that were in these dimensions. it's currently chugging away with 704x480, but i'm pretty confident that will be the main show content.

i had a thought about how to integrate this logic (albeit ungracefully) directly into the QSF vbs file. The user could set up manual if/else statements based upon values in the tivo file name. So it would look something like:

if showname contains "msnbc" set VideoReDo.SetFilterDimensions 704, 480
if showname contains "daily show" VideoReDo.SetFilterDimensions 528, 480
else, no filter

The onus would be on the user to manually determine the dominant dimension of each file and modify the QSF script, but for season pass/auto transfers it would be a set it and forget solution.

...just a thought.

EDIT: Sorry for the double post... original reply was not showing up originally.
Interesting idea. If you want to pursue it on your own and are not fluent in VBscript, here is a good tutorial site. (http://www.w3schools.com/vbscript/default.asp). Look in the reference area and at the string functions. InStr performs the "contains" function. I don't have much VBscript experience myself but am able to muddle through with help from sites like this and the examples in the VRD help, plus experimentation.

I'm hoping VRD will come up with the function to determine the dominant size before long. I would think they need to do something along these lines in VRD just to properly serve customers like you. It would also be possible to integrate your idea into TVAP based on an optional user-supplied list, with default behavior if the list isn't present.

[goodtrips]

It took a lot of VBScript fumbling and bumbling, but I think I got it:


if instr(Args(0), "the foobar show") > 0 then
VideoReDo.SetFilterDimensions 704, 480
elseif instr(Args(0), "foobar with the stars") > 0 then
VideoReDo.SetFilterDimensions 352, 480
elseif instr(Args(0), "foobar tonight") > 0 then
VideoReDo.SetFilterDimensions 704, 480
end if

Knock on wood, but least so far, seems to be working great for me. It will let HD content passthrough the filter statements unscathed, and the show title keywords seem to be working successfully. If anyone sees anything ridiculous with my hacked together code, though, please let me know (or at least keep the laughing to a minimum).

Thanks again for your help, dlflannery!

[dlflannery]

It took a lot of VBScript fumbling and bumbling, but I think I got it:


if instr(Args(0), "the foobar show") > 0 then
VideoReDo.SetFilterDimensions 704, 480
elseif instr(Args(0), "foobar with the stars") > 0 then
VideoReDo.SetFilterDimensions 352, 480
elseif instr(Args(0), "foobar tonight") > 0 then
VideoReDo.SetFilterDimensions 704, 480
end if

Knock on wood, but least so far, seems to be working great for me. It will let HD content passthrough the filter statements unscathed, and the show title keywords seem to be working successfully. If anyone sees anything ridiculous with my hacked together code, though, please let me know (or at least keep the laughing to a minimum).

Thanks again for your help, dlflannery!
Good deal! I've got to look into this "foobar" show that you seem to like so much! :D

[zaphod7501]

I always thought it was "fubar". (f'd up beyond all repair)

[goodtrips]

darn -- was trying to build my coder cred, but like my code, i was spotted for a fraud :)

http://en.wikipedia.org/wiki/Foobar

[dlflannery]

16 April 2008 Ver. 0.59
- Added command line option "-hotstart". If present, TVAP starts processing on startup without
clicking the Start Processing button, and minimizes itself (after the usual 18 second delay
to check for new TiVo files).

Add the option (and/or the -p# process priority option) as follows in the Target section of the TVAP shortcut properties:

"<Path>\Tivo-VideoReDo-AutoProcessor.exe" -hotstart

Also remember with this option you will not have a chance to review process settings for new tivo files prior to starting processing.

[dlflannery]

20 April 2008 Ver. 0.59a
- No changes to program.
- Installer changes:
1. TivoCom.dll (TivoDecode COM file for reading metadata from Tivo files) is now installed
in C:\Program Files\Common Files\TivoDecode folder.
2. The shared DLL counting feature of Windows registry is used to count number of programs
currently using this DLL. Uninstall will not unregister or delete until count is zero.
These changes were needed because two programs that I know of (TVAP and pyTivoMetaGen) both
use the same DLL and uninstalling one could cause the other to stop reading metadata. Also
to get the DLL out of the system32 folder which is not recommended. It is hoped but not tested
that the installer will provide a functioning TivoCom.dll install on Vista x64 systems now.

Note: If you use both TVAP and pyTivoMetaGen you should uninstall both and reinstall them with the latest versions. This will keep the registry tracking of programs using the TivoCom.dll from getting confused. The new version of pyTivoMetaGen (0.35a) is also an installer-only change to implement TivoCom.dll sharing and counting.

[dlflannery]

No functional program changes.

This installer and program build will install and run TVAP correctly on either a 32bit (x86) or 64bit (Vista x64) system.

[dlflannery]

More metadata content in ouput DVR-MS files.

[stimpy99]

Super concept, had to install.
First, Vista POS,
.Net 2 installed but not on Program add/rem list.
Service installed and is started.
Ran your script, just said complete, not any .net ver no's.

Vista, running admin, but get (no permission msgs alot..) Thanks Bill Gated (anti-christ)
This is assumed admin is needed per your prev. threads

Any help on know issues here is appreciated.

Cant wait to see this crunch.


Stimpy

[dlflannery]

Super concept, had to install.
First, Vista POS,
.Net 2 installed but not on Program add/rem list.
Service installed and is started.
Ran your script, just said complete, not any .net ver no's.

Vista, running admin, but get (no permission msgs alot..) Thanks Bill Gated (anti-christ)
This is assumed admin is needed per your prev. threads

Any help on know issues here is appreciated.

Cant wait to see this crunch.


Stimpy
Hmmm... Having trouble interpreting your post. The script may not run correctly on Vista -- not sure anyone tested it there. I think .NET 2.0 is automatically there in a Vista installation. (I don't have a Vista machine to test on.)

However if you are having trouble getting TVAP installed or running, please furnish a more detailed post and I will try to help.

[wvatxman]

I am using beyond tv and was wondering if you could set it up to automatically remover commericals from recorded shows?

[bits]

I am using beyond tv and was wondering if you could set it up to automatically remover commercials from recorded shows?
Accurate dependable fully automatic commercial removal does not exist and probably never will. If it did someone would be making a lot of money. The closest you can come is for automatic commercial detection + manual cut verification + batch process to the folders of choice.

[dlflannery]

Accurate dependable fully automatic commercial removal does not exist and probably never will. If it did someone would be making a lot of money. The closest you can come is for automatic commercial detection + manual cut verification + batch process to the folders of choice.
...and TVAP will automate everything except the few minutes you spend on "manual cut verification". Just set it up to produce a VRD project file (.vprj), (check Do Ad Scan but do not check Auto Cut After Ad Scans, in the Default settings panel). Then if you manually load the .vprj file into VRD, make your cut mods and save the .vprj file (same name), TVAP will automatically run VRD to create the final edited output file, the next time it is processing.

But remember, TVAP has to start with TiVo files only.

[bits]

...and TVAP will automate everything except the few minutes you spend on "manual cut verification". Just set it up to produce a VRD project file (.vprj), (check Do Ad Scan but do not check Auto Cut After Ad Scans, in the Default settings panel). Then if you manually load the .vprj file into VRD, make your cut mods and save the .vprj file (same name), TVAP will automatically run VRD to create the final edited output file, the next time it is processing.

But remember, TVAP has to start with TiVo files only.
You have done a great job with TVAP.

I accomplish pretty much the same using Dirmon2 + comskip. Dirmon2 is a freeware application starter that starts comskip working on a file once the file has completed recording. comskip then outputs a vprj file that I then manually load into vrd. Manual cut confirmation takes 15 to 45 secs per file. Once the file is verified I drop into vrd's batch processor and it outputs the commercial free file/files to the desired Drive/Folder.

[dlflannery]

26 May 2008 Ver. 0.61
- Added time delays of a few seconds and two retries in VideoReDo AdScan file open to prevent file open errors encountered by one user on DVR-MS files.

If you haven't been experiencing file open errors there is really no reason to install this version. (Changes will be in all future versions, of course.)

[dlflannery]

28 May 2008 Ver. 0.62
- TVAPpostProcess batch file will be run for EITHER mpeg2 or dvr-ms outputs.

See this post on the TivoCommunity TVAP thread (http://www.tivocommunity.com/tivo-vb/showthread.php?p=6327072#post6327072)for more details.

[dlflannery]

31 May 2008 Ver. 0.63
- If a QSF file is automatically deleted, the project (.vprj) file linked to it is also deleted.

- If a batch file named TVAPcleanUp.cmd (or TVAPcleanUp.bat) is present in the final destination folder when an output file is completed, it will automatically be run by TVAP. The single argument passed to the file is the "bare" video file name (no path, no extension). If a TVAPpostProcess file is used, the cleanup batch is run afterwards, not before.

- A new command-line argument, -noMeta, will prevent TVAP from writing any pyTivo-style meta-data files. Default continues to be writing the files.

[dlflannery]

7 July 2008 Ver. 0.64
- Added additional time delays and retries detecting input files -- defensive programming to minimize possible problems due to OS glitches.
9 July 2008 Ver. 0.65
- Corrected sequencing error that caused pyTivo metadata file not to be written until after the TVAPpostProcess batch file ran -- when AdScan with Autocuts was done.

[linfor]

Anyone have version .57? I updated to version .64 and had a lot of problems. Tried using .65 and ended up losing all my raws.
Both .64 and .65 seems to have a problem terminating the VIdeoredo process when the adcuts is run. Files that use to take 9 minutes to QSF and adcut is now taking more than 25 minutes and sometimes my whole system locks up. I neber used to have that problem. When I check taskmaster I can see that the videoredo is finished processing but the tvap does not seem to recognize that.
I tried setting the priority to normal but that did not fix the problem.
Also, is there a way to stop it from defaulting to "delete QSF' in the individual file settings? I prefer to delete them manually or have them moved to a different directory because sometimes the finished videos have errors and I have to go back to the QSF

I would like to use the .57 if anyone still have it.

[dlflannery]

Anyone have version .57? I updated to version .64 and had a lot of problems. Tried using .65 and ended up losing all my raws.
Both .64 and .65 seems to have a problem terminating the VIdeoredo process when the adcuts is run. Files that use to take 9 minutes to QSF and adcut is now taking more than 25 minutes and sometimes my whole system locks up. I neber used to have that problem. When I check taskmaster I can see that the videoredo is finished processing but the tvap does not seem to recognize that.
I tried setting the priority to normal but that did not fix the problem.
Also, is there a way to stop it from defaulting to "delete QSF' in the individual file settings? I prefer to delete them manually or have them moved to a different directory because sometimes the finished videos have errors and I have to go back to the QSF

I would like to use the .57 if anyone still have it.
I've put the installer for Ver. 0.57 on the download site so you can try it.

Be sure to uninstall any current version before installing another one.

Some questions:
1. What version of VRD are you running?
2. What operating system and version?
3. What output file type are you producing from VRD?
4. Are you manually reviewing adscan cuts, i.e., running adscan to produce the project (.vprj) file only?
5. Are you running a TVAPpostProcess batch file?
6. Are any of your destination folders on USB hard drives or network drives?

According to VRD help info, the speed of AdScan can vary by more than 2X depending on whether you have "Enable Fast Search" checked in the Ad Detective Parameters. TVAP runs AdScans in the slow mode, but it has always done that.

Regarding QSF auto-delete, if you uncheck Delete QSF's in the default settings box it will not default to deleting them.

Please post any further findings.

[linfor]

Thanks a lot.

Some questions:
1. What version of VRD are you running?
I am running .64 now
2. What operating system and version?
WindowsXp Home Version 2002 SP 3
3. What output file type are you producing from VRD?
mpg
4. Are you manually reviewing adscan cuts, i.e., running adscan to produce the project (.vprj) file only?
Yes. I do the QSF and adcuts and then edit manually.
5. Are you running a TVAPpostProcess batch file?
No
6. Are any of your destination folders on USB hard drives or network drives?
The destination drive is a firewire external. But when I set it for the regular harddrive it had the same problem.

With the previous vesion of TVAp that I was using it was below normal in priority for Videoredo but on average the QSF and adcut files took 9 minutes. Now they take at least 2-3 times as much time and videoredo often locks up or just sits there after processing a file. After every 2-3 files I have to manually go into taskmanager and end the Videoredo process.

[dlflannery]

linfor:

You said VRD version 0.64, I think that is your TVAP version. What version of VideoReDo are you running? Have you updated to a newer version recently? What if you run the QSF and AdScan in VRD without TVAP? Be sure that "Enable Fast Search" is not checked in the Ad Detective parameters, for a fair comparison.

You might want to uninstall and re-install VideoReDo, with a re-boot between. Also, could there be an update for .NET 2.0 that's needed? (Check with Windows update.)

When processes take so long, does the progress bar in TVAP move slower, or does it move to 100% then hang there for a long time? I would be curious to see excerpts from the TVAP log file for those cases (and from prior runs where the slow down wasn't present too). Also, I assume you are comparing processing times for the same length and type of videos (?).

The way TVAP runs VRD processes and monitors their completion hasn't changed at all over the different TVAP versions. Actually if the VRD process is showing in task manager then TVAP would not detect it as completed -- TVAP has no control of how long the VRD process takes to run once it is started (other than if you abort with the Stop button).

A low priority process will run at the same speed as normal priority unless a higher priority process is competing with it. I don't think process priority has anything to do with your problems. How much memory and % cpu time is the VRD process using per Task Manager? What is your CPU speed and total memory?

[dlflannery]

- Can now navigate Transferred TiVo File list with up/down arrow keys while changing settings in the Settings For Selected File panel without having to mouse click in list to recover focus.
- New Command-line argument: -shutdown:## where ## is the minutes after startup when TVAP will automatically shutdown -- but only after completing whatever video it was processing when the shutdown time was reached. This feature is only active if the -hotstart CL argument is used.
This allows TVAP to be started by the Windows scheduler, run for (at least) the specified time then shut down. Note: no spaces allowed anywhere in this argument.

[dlflannery]

10 August 2008 Ver. 0.68
- Fixed: Tray Notify Icon remained after auto-shutdown.
- If your TVAPpostProcess or TVAPcleanUp batch file writes text lines to a file named TVAPlog.txt located in the folder containing the batch script, these text lines will be added to the TVAP log display and log file AFTER the batch completes. TVAP will prepend "BATCH MSG: " before each log line. TVAP attempts to delete the file after it has read it. If it can't (perhaps due to some permission problem) it adds a log message to that effect.

Here is an example of how to write a TVAP log line from your batch files:

set localDir=I:\videos\adscan\
echo Your text message line >> "%localDir%TVAPlog.txt"
localDir should be the folder containing the batch file and be sure to include the final '\' at the end.

You can echo as many lines as you choose (but they are only added to the TVAP log after your batch file completes).

[dlflannery]

6 September 2008 Ver. 0.69
- If you click the "Run VideoReDo" button for a file with status AWAITING CUTS (i.e., one for which AdScan without autocuts has been run, and it is waiting for you to do manual cuts), the project (.vprj) file will be loaded into VideoReDo.

[dlflannery]

If you are interested in having automated MPEG4 conversion built into TVAP, instead of requiring a user-defined post process batch file as is currently done, please chime in here.

A recently released Source Forge project called fflib.net (http://www.intuitive.sk/fflib/post/fflib-net-released.aspx)makes it relatively easy to add this capability to TVAP.

The advantage would be simplicity. However if you are already using the post process batch method there will be no advantage. In fact the price for simplicity is limited configurability. You will not have all the parameters and options for fine tuning conversions that you have when using HandBrake in a post process batch.

fflib.net is somewhat of a black box. There is almost no documentation. However in my initial testing it has converted to .mp4 with H264 video and AAC audio, .avi with MPEG4 video and mp3 audio, and FLV. You can set the video size and video- and audio-bitrates --- or you can let them default to automatic settings which seem halfway reasonable at least.

In one test I converted an hour long .mpg, which was generated by VideoReDo performing a QSF on a .tivo file. The output file was a .avi and I sent it back to my TiVo via pyTivo. It was quite acceptable.

I don't know if the .mp4's it produces are iPod compatible. If someone will tell me the video format and bitrates I will convert a small .mp4 and get it to them for test on their iPod.

My current thought is to have this capability as an automatic option in TVAP. If the fflib.net DLL file is installed in the run-time directory, TVAP will enable the option. The current post process batch capability would still be there in either case. I would add a button to pop up a configuration page where you would select video size, file fomat and bitrates, or defaults.

Let me know if you're interested.

[dlflannery]

Tiny change: The title item in the pyTivo metadata file no longer incorporates the episode # and episode name (for series).

Remember to uninstall the previous version.

[gjlutz]

The TVAP program looks like EXACTLY what I'm looking for - only backwards... can this be used to watch Media Center Recorded TV, and process/convert to .TIVO for Tivo Desktop to Transfer to TIVO?

My situation is... I have a dual tuner Tivo... and for overflow - I use my Vista MCE / HDHomeRun - and then manually use VideoReDo to convert to .Tivo for transfer - watching all programs on the Tivo.

Can the TVAP be used in this manner? Or purely for .Tivo as input only....

Thank you!
g

[dlflannery]

Sorry gjlutz but TVAP only uses .TiVo inputs. Conceivably a version to use other inputs (.dvrms?) and convert to .TiVo might not be too hard to make as a mod of TVAP, but I don't have Vista or MediaCenter for testing so it isn't practical for me to do it.

Search this forum, and Google, for "dirmon", which might a way to do what you want.

When you convert .dvrms to .tivo do you get the metadata ? (I suspect not.)

[gjlutz]

Thank you for your response... I will look into your suggestion... and, no... unfortunately I do not get any metadata when I convert from dvrms to tivo manually....

Gary