I've not found much help or documentation on how to manually push web pages (using C#) that you've crawled yourself. Why would anyone want to do this? Omnifind does not have windows authentication built in (which is fine), so we needed to do our own crawling. Once crawled, we had to manually push the document into Omnifind.
I've blogged this at
http://www.xdevsoftware.com/blog/?tag=/omnifind. This only shows how to push the document into Omnifind using C#. If you'd like to find out more about crawling, please post on the blog with your request. Feel free to post questions as well.
The end.