DBSight - Database Search Engine - Instant Scalable Full-text database search platform/engine

DB Data not search

Tue, 31 Aug 2010 17:18:46 +0000

Hi
i have connected to sqlserver database.
but when i m searching data which is present in my DB.
it shows:
No Results found.
Administrators, please put instructions on how to search here(noResults.ftl), so your users can know how to search.
Plz help me.

Word with accent, for example "Téléphoner"

Fri, 20 Aug 2010 09:25:43 +0000

Hi,
I don't understand why it's doesn't work.
In fact, when I write "Téléphoner" in the search field, and then I press Enter, Dbsight change the word in the search field like that : tÃ©lÃ©phoner. All the words with accent are like that.
So the result are incorrect.
Can you help me please?
Sam

Robust indexing on fragile network

Thu, 19 Aug 2010 17:04:44 +0000

Indexing stops at the first link failure. The least it could do, is retrying a couple of times with increasing interval times. Maybe it could even remember the current state to resume at a later moment.

WARN 10-08-18 13:25:13,967| SQLException is:com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

The last packet successfully received from the server was 273,557 milliseconds ago. The last packet sent successfully to the server was 12,548 milliseconds ago. |a:execute
WARN 10-08-18 13:25:13,967| SQLException is:com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

Slower indexing since 3.2.4

Sat, 14 Aug 2010 11:03:28 +0000

Indexing takes considerably longer compared to version 3.1.9. There is a period of about 40 minutes with high hdd acticity and no log file entries. Without those 40 minutes, the indexing time would be approximately equal.

I have found "Add option to optimize the index after indexing." in the changelog, but under data source -> advanced settings, optimize index is not enabled.
Here is part of the indexing log, let me know if you need more information:

WARN 10-08-14 12:07:08,746| IW 0 [main]: commit: done |LoggerPrintStream:a
WARN 10-08-14 12:07:08,746| IW 0 [main]: at close: _0:c853 _1:c571 _2:c778 _3:c798 _4:c538 _5:c397 _6:c672 _7:c794 _8:c744 _9:c826 _a:c806 _b:c552 _c:c416 _d:c679 _e:c748 _f:c770 _g:c784 _h:c754 _i:c595 _j:c381 _k:c640 _l:c819 _m:c783 _n:c757 _o:c723 _p:c574 _q:c272 _r:c569 |LoggerPrintStream:a
INFO 10-08-14 12:07:08,747| Directory is marked ready: /home/search/dbsight/webapps/dbsight/WEB-INF/data/indexes/name_of_index/temp1 |IndexStatus:setIndexReady
INFO 10-08-14 12:07:08,747| Indexing Context closed! |a:stopAll
INFO 10-08-14 12:07:08,748| Directory is marked ready as up-to-date: /home/search/dbsight/webapps/dbsight/WEB-INF/data/indexes/name_of_index/temp1 |IndexStatus:setIndexReady
INFO 10-08-14 12:07:08,748| Directory is marked not ready: /home/search/dbsight/webapps/dbsight/WEB-INF/data/indexes/name_of_index/temp0 |IndexStatus:setIndexNotReady
INFO 10-08-14 12:07:08,776| Directory is marked ready as up-to-date: /home/search/dbsight/webapps/dbsight/WEB-INF/data/indexes/name_of_index/temp1 |IndexStatus:setIndexReady
INFO 10-08-14 12:07:08,776| Directory is marked not ready: /home/search/dbsight/webapps/dbsight/WEB-INF/data/indexes/name_of_index/temp0 |IndexStatus:setIndexNotReady
INFO 10-08-14 12:47:18,417| ~~~~~~~ name_of_index: ... |IndexManager:start
INFO 10-08-14 12:47:20,741| ~~~~~~~ name_of_index:mergeIndexesIfNeeded ... |IndexManager:start
INFO 10-08-14 12:47:23,817| temp indexes size is 2.71% of the whole directory |IndexMerger:needToMergeSubDirectories
INFO 10-08-14 12:47:24,017| thresh hold to merge temp indexes size is 5% |IndexMerger:needToMergeSubDirectories
INFO 10-08-14 12:47:24,125| ~~~~~~~ name_of_index: ... |IndexManager:start
INFO 10-08-14 12:47:24,133| ~~~~~~~ name_of_index:buildDictionaryIfNeeded ... |IndexManager:start
INFO 10-08-14 12:47:25,539| ~~~~~~~ name_of_index:ping-a-url ... |IndexManager:start
INFO 10-08-14 12:47:25,540| ------- name_of_index:completed, Time used: 2474 seconds |IndexManager:start
INFO 10-08-14 12:47:25,805| Stop retrieving ... |a:a
WARN 10-08-14 12:47:26,308| stopping indexing for name_of_index |SchedulerTool:stop
INFO 10-08-14 12:47:31,640| Period Table: [1970/01/01 01:00:01 CET ~ 2010/08/14 12:06:33 CEST] |a:a
INFO 10-08-14 12:47:31,721| Indexing Context closed! |a:stopAll

Non-alphanumerical characters in search keywords

Wed, 04 Aug 2010 22:07:26 +0000

Hi,
We are confused by the search behavior when there are non-alphanumerical characters in the search keywords.
For example,
- Search "Ben 10: Ultimate Alien", the ":" will automatically be removed from the search keyword, and "Ben 10:Ultimate Alien" will have low scores.
- Search "Ben 10:Ultimate Alien", then "Ben 10: Ultimate Alien" will have low scores
- Search "Where's Waldo? Nintendo DS", it seems "Where's" can't be matched.
We are using "One Word, Number or LowerCase" analyzer.
Thanks in advance for your help!
Best,
Phil

Next Release

Wed, 28 Jul 2010 14:50:10 +0000

Do you know when the next major version of DBSight is released?

Synchronize data with SalesForce.com to Search!

Tue, 20 Jul 2010 07:30:48 +0000

Now you can create an index via customized fetcher, and select the SalesForce.com adapter, fill in username/password and the object you want to search on, like "Account".

The rest is exactly the same as ordinary database search configuration.

The good thing is, the incremental indexing will also work. You just schedule the job. And on SalesForce.com side, you need to make the object replicable. This replicable setting doesn't matter if you create index from scratch.

Linearly Scale DBSight with Sharded Search

Tue, 13 Jul 2010 19:51:49 +0000

As your data grows, one single box can not hold all of your data. So what to do? Buy a bigger box or add another box?

Getting a bigger box may work for some. Actually it's much simpler and cost less on man-hours. A few thousands of dollars are much cheaper than putting several developers on it.

Of course, Sharded Search can go further by just adding more computer boxes.

DBSight can now support sharded search now! And you don't need to do much. Just adjust the search URL!

Suppose you are 2 indexes on 2 different boxes. The URL format is pretty simple, just say:

 ?indexName=index1,index2@hostname2:port2/dbsight

Boolean operator problem

Tue, 29 Jun 2010 22:33:23 +0000

I can't get the boolean logic operator to work. I have selected 'AND mode for all keywords' under the 'Configure search' > 'search options' tab, but is does not seem to have any effect on the seachresults. Also appending '&booleanOperator=and' to the search url did not work.

I have combined the Q en LQ parameters in the same URL, the Q parameter contains the date ranges, the LQ parameter the words to be searched for in Lucene syntax.

When I put AND between the words manually there is no problem at all, also combining AND and OR seems to work correctly.

Letting the PHP script (which sends the query to DBSight) add the AND operator between the keywords is no option, it did not work not as expected when using complex queries.

Property weaving

Thu, 27 May 2010 10:55:22 +0000

I would like to know if it is possible to use a property file which contains the url of the database, the username en password.

At this moment we are building the dbsearch solution for different environments. We don't want to rebuild for every environment.

By using a property file outside the scope of the application server we could make the installation environment clean.

One Click to Sync Remote Index Configuration and Automatic Subscribing!

Fri, 09 Apr 2010 00:09:15 +0000

This is an interesting feature!

Usually if you have several DBSight servers, you may have to log on to several servers to copy index configurations. And sometimes it is hard to track which one has the latest change.

For Enterprise licenses, to use the Remote Index Replication feature, you also need to setup where the master index is.

Now everything is just one click away!

If you have the remote DBSight server's password, you can browse the local network, copy the remote index configuration and templates with one click!

Could not start the DBSight Database Search Server service on local Computer

Tue, 09 Feb 2010 17:04:53 +0000

I receive the following error when attempting to start the DBSight Database Search Server service
"Could not start the DBSight Database Search Server service on local Computer. Error 1067: The process terminated unexpectedly." when launching DBSight application it starts and runs fine.
Config
Windows Server 2003 64-Bit
apache_2.2.11
apache_tomcat_6.0.20
jre-6u14

Record not getting deleted from the index

Tue, 02 Feb 2010 21:35:14 +0000

Incemental indexing is not deleting the record from the index. It finds the record that should be deleted but terminates before updating the index. The log says "Running flag file not found. Process terminating".
What is running flag?

Following is fragment of log:

INFO 2010-02-02 15:12:55,009- 1 processed...
INFO 2010-02-02 15:12:58,024- 1814 processed...
INFO 2010-02-02 15:13:01,180- 3001 processed...
INFO 2010-02-02 15:13:05,367- 4001 processed...
INFO 2010-02-02 15:13:08,398- 6001 processed...
INFO 2010-02-02 15:13:09,960- Dir size:7,598,484 Bytes
INFO 2010-02-02 15:13:11,429- 7769 processed...

Multiple index from the same database

Fri, 15 Jan 2010 21:44:50 +0000

I want to create multiple indexes. The columns for both the indexes are same. Each index fetches data from the same database but different schemas.
I could have configured a single index with a union query from both the schemas, but I just want to avoid this.
Your document says that I should not configure two indexes for the same databse else the increamental indexing will run into each other and later job will abort the previous indexing job.
Is it still a limitation?
What if I use two different users in the the configured datasource for each index?
What is the best solution?

how to control index with different right?

Tue, 12 Jan 2010 02:55:12 +0000

I have three indexs like index1;index2;index3,so I want to distribution different right to indexs. example:

user A just can use index1;
user B can use index1 and index2

pls help me. TKS!