Tag Archives: performance

Elasticsearch vs. Solr: performance improvements

Posted on by
Reply

I had been planning not to continue with these posts, but after Matt Weber pointed out the github pull requests (which to my embarrassment I'd not even noticed) he'd made to address some methodological flaws, another attempt was the least I could do. For Solr there was a slight reduction in mean search time, from 39ms (for my original, suboptimal query structure) to 34ms and median search time from 27ms to 25ms - see figure 1. Elasticsearch, on the ...Continue reading

Luwak 1.3.0 released

Posted on by
Reply

The latest version of Luwak, our open-source streaming query engine, has been released on the Sonatype Nexus repository and will be making its way to Maven Central in the next few hours.  Here's a summary of the new features and improvements we've made: Batch processing I...Continue reading

Elasticsearch Percolator & Luwak: a performance comparison of streamed search implementations

Posted on by
2

Most search applications work by indexing a relatively stable collection of documents and then allowing users to perform ad-hoc searches to retrieve relevant documents. However, in some cases it is useful to turn this model on its head, and match individual documents against a collection of saved queries. I shall refer to this model as "streamed search". One example of streamed search is in media monitoring. The monitoring agency's ...Continue reading

Innovations in Knowledge Organisation, Singapore: a review

Posted on by
Reply

I'm just back from Singapore: my first visit to this amazing, dynamic and everchanging city-state, at the kind invitation of Patrick Lambe, to speak at the first Innovations in Knowledge Organisation conference. I think this was probably one of the best organised and most interesting events I've attended in the last few years. The event started with an enthusiastic ...Continue reading

Going international – open source search in London, Berlin & Singapore

Posted on by
Reply

We're travelling a bit over the next few weeks to visit and speak at various events. This weekend Alan Woodward is at Berlin Buzzwords, a hacker-focused conference with a programme full of search talks. He's not speaking this year, but if you want to talk about Lucene, Solr or our own Luwak stored search library and the Continue reading

Elasticsearch London Meetup: Templates, easy log search & lead generation

Posted on by
1

After a long day at a Real Time Analytics event (of which more later) I dropped into the Elasticsearch London User Group, hosted by Red Badger and provided with a ridiculously huge amount of pizza (I have a theory that you'll be able to spot an Elasticsearch developer in a few years by the size of their pizza-filled belly). ...Continue reading

Comparing Solr and Elasticsearch – here's the code we used

Posted on by
Reply

A couple of weeks ago we presented the initial results of a performance study between Apache Solr and Elasticsearch, carried out by my colleague Tom Mortimer. Over the last few years we've tested both engines for client projects and noticed some significant performance differences, which we thought deserved fuller investigation. ...Continue reading

London Elasticsearch User Group – September Meetup

Posted on by
2

Last night I joined a good-sized crowd at a venue on Hoxton Square for some talks on Elasticsearch - this Meetup group is very popular and always attracts a good proportion of people new to the world of search, as well as some familiar faces. I started with a quick announcement of our own Elasticsearch hackday in a few weeks ti...Continue reading