Posts

Showing posts with the label CISTI

ICSTI Conference: Managing Data for Science

CISTI (Canada Institute for Scientific and Technical Information) is hosting the ICSTI (International Council for Scientific and Technical Information) conference " Managing Data for Science " here in Ottawa at the LAC (Library and Archives Canada). The conference is June 9-10, 1 1/2 days long with an excellent international single stream program structured into four sessions, " Foundations ", " Libraries ", " Data Services " and " Semantic Science ". I will be attending all sessions and will also be moderating the " Semantic Science " session.

Software Announcement: LuSql: Database to Lucene indexing

LuSql is a simple but powerful tool for building Lucene indexes from relational databases. It is a command-line Java application for the construction of a Lucene index from an arbitrary SQL query of a JDBC -accessible SQL database. It allows a user to control a number of parameters, including the SQL query to use, individual indexing/storage/term-vector nature of fields, analyzer, stop word list, and other tuning parameters. In its default mode it uses threading to take advantage of multiple cores. LuSql can handle complex queries, allows for additional per record sub-queries, and has a plug-in architecture for arbitrary Lucene document manipulation. Its only dependencies are three Apache Commons libraries, the Lucene core itself, and a JDBC driver. LuSql has been extensively tested, including a large 6+ million full-text & article metadata document collection, producing an 86GB Lucene index. I am the author of the LuSql software. LuSql at CISTI Lab LuSql at freshmeat Upda...

Minion: possible research alternative to Lucene

I am excited to learn from The Search Guy about the recently released research-oriented full-text engine from Sun Labs called ' Minion '. Minion the Open Source Search: One of the secret weapons underlying the Search Inside the Music project and Project Aura is a high quality search engine called Minion. Minion handles everything that has to do with Text for these projects. In addition to traditional search, we use Minion for document similarity (the core technique used for Tagomendations), item clustering, sense disambiguation, classification and autotagging. Minion is a research-oriented search engine - meaning that it is designed to allow for all sorts of variations. It is ultra-configurable and has a simple API. The big news is that the process to open source the Minion engine is underway. Steve Green (aka the search guy) has created a Minion project on Java.net - and soon, the Minion search engine will be available for all. " Right now there is limited real info on ...