ivinco

Blog

Technical insights from a senior engineering team in production since 2009. Kubernetes, data pipelines, AI agents, DevOps, and engineering leadership.

Posts

Massive Indexing with Sphinx

Massive Indexing with Sphinx

Imagine the following situation: multiple Sphinx daemons are serving huge amount of data running on numerous hardware servers.

Sphinx: building 1M docs index having no one real doc

Sphinx: building 1M docs index having no one real doc

Just want to share an interesting trick on how to easily index something with Sphinx without need of populating database with a lot of data or doing smth...

Correct ordering of search result set using Sphinx

Correct ordering of search result set using Sphinx

**Once you get results from Sphinx, it is important to maintain the way they are ordered. The typical search process used by Sphinx looks like the following:**

Sphinx in Action: Fuzzy matching and 2nd pass query

Sphinx in Action: Fuzzy matching and 2nd pass query

This is a post from a series of posts called "Sphinx in Action".

Sphinx in Action: Top related queries

Sphinx in Action: Top related queries

This is a post from a series of posts called "Sphinx in Action".

Sphinx in Action: How Sphinx handles text during indexing

Sphinx in Action: How Sphinx handles text during indexing

This is a post from a series of posts called "Sphinx in Action".

Sphinx in Action: Autocomplete

Sphinx in Action: Autocomplete

This is a post from a series of posts called "Sphinx in Action".

Sphinx in Action: It all starts with indexing

Sphinx in Action: It all starts with indexing

This is a post from a series of posts called "Sphinx in Action".

Sphinx in Action: Did you mean ... ?

Sphinx in Action: Did you mean ... ?

This is a post from a series of posts called "Sphinx in Action".

Sphinx in Action: Good and bad in Sphinx real time indexes

Sphinx in Action: Good and bad in Sphinx real time indexes

This is a post from a series of posts called "Sphinx in Action".

Meet Ivinco at Sphinx Search Day 2012!

Meet Ivinco at Sphinx Search Day 2012!

The Sphinx team has just announced [The Sphinx Search Day](http://sphinxsearch.com/conference2012/), which will take place in Santa Clara, California on...

SphinxSearch kill list feature

SphinxSearch kill list feature

In using the SphinxSearch sql_query_killlist I am faced with a problem - the kill list doesn't always work as expected for several distributed indexes.

Group by MVA in SphinxQL

Group by MVA in SphinxQL

This is a just a quick note I'd like to share since this might be confusing how one should do "group by" mva attribute in SphinxQL.

Converting Sphinx original indexes to real-time indexes

Converting Sphinx original indexes to real-time indexes

If you are using the Sphinx server with many indexes and you decide to move to real-time indexes then this article is for you.

Email me mysql/sphinx query result

Email me mysql/sphinx query result

Hi. Here's just a simple trick which can be useful if you run some long-lasting mysql/sphinx query in a screen or whatever and want to get informed as soon...

Interesting thing about BM25 in Sphinx Search

Interesting thing about BM25 in Sphinx Search

I recently faced strange behaviour of Sphinx Search. As I investigated, the problem turned out to be in the default ranking mode SPH_RANK_PROXIMITY_BM25...

Sphinx RT-indexes memory consumption issue

Sphinx RT-indexes memory consumption issue

The Sphinx team recently published new article about [Sphinx memory consumption](http://sphinxsearch.com/blog/2011/11/11/sphinx-memory-consumption/).

We are speaking at Percona Live London, Oct 24-25

We are speaking at Percona Live London, Oct 24-25

We’re thrilled that we will be speaking at [Percona Live conference](http://www.percona.com/live/london-2011/).

High performance BuildExcerpts() with Sphinx Search

High performance BuildExcerpts() with Sphinx Search

Since version 2.0.1 Sphinx has ability to build snippets in a parallel mode. It means that Sphinx will use several CPUs to do that.

Wordpress Sphinx Search plugin version 3.0 released

Wordpress Sphinx Search plugin version 3.0 released

We're glad to announce the third version of WordPress Sphinx Search plugin.

Minimal Sphinx configuration to play with Sphinx

Minimal Sphinx configuration to play with Sphinx

If you want to start learning Sphinx or see how some its feature works the following simplest Sphinx configuration might be useful:

How to speed up Sphinx Real Time indexes up to 5-10 times

How to speed up Sphinx Real Time indexes up to 5-10 times

New type of index (Real Time) was released in Sphinx Search version 1.10.

Using wget as a simple web crawler for Sphinx search engine

Using wget as a simple web crawler for Sphinx search engine

The following is just a proof of concept which shows that it's possible to make a search engine of a web site with minimal tools and knowledges:

Copying Sphinx index from different server

Copying Sphinx index from different server

One day I had to build one huge index. I couldn't do it on a production box, because there was little space and I decided to build the index in another...

Scripting in Sphinx config

Scripting in Sphinx config

Did you know that Sphinx config enables you to use [shebang syntax](http://en.wikipedia.org/wiki/Shebang_(Unix))?

Indexer for real-time indexes

Indexer for real-time indexes

We’ve implemented a script which should help when you need to migrate from plain indexes to real-time (RT) indexes or simply make first-time RT indexing.

Sphinx replication

Sphinx replication

Sphinx doesn’t yet support any replication for plain or RT indexes out of the box, so you have to implement something by yourself if you need to have a copy...

Plain, RT and mixed indexes performance comparison

Plain, RT and mixed indexes performance comparison

**Plain index** is an index which has ‘source’ section in the Sphinx config file and filled by means of ‘indexer’ tool.

Should you switch to Sphinx real time indexes?

Should you switch to Sphinx real time indexes?

The main inconvenience of regular indexes is their update speed. In order to update one you should entirely rebuild it.

Talking at Sphinx User Conference 2010

Talking at Sphinx User Conference 2010

Sphinx Technologies announced their first [Sphinx User Conference](http://sphinxsearch.com/conf2010.html).

Five ways to configure Sphinx search engine

Five ways to configure Sphinx search engine

If you ever used Sphinx Search you’ve probably tried one of the configurations listed below. Each of them is suitable for particular types of projects.

Using Sphinx search engine with Chinese, Japanese, and Korean language documents

Using Sphinx search engine with Chinese, Japanese, and Korean language documents

This article explains step by step how to implement full-text search on a set of documents written in Chinese, Korean and Japanese languages (CJK).

Announcing DokuWiki Sphinx Search Plugin

Announcing DokuWiki Sphinx Search Plugin

At Ivinco we use [DokuWiki](http://www.dokuwiki.org/) and so does many of our friends and customers.

How To Improve Sphinx Indexing Performance

How To Improve Sphinx Indexing Performance

Sphinx indexing often can be very “heavy” process for the system – it uses a lot of CPU and I/O resources.

Welcome To Ivinco Blog!

Welcome To Ivinco Blog!

At Ivinco we build and maintain PHP/MySQL driven systems. We also specialize in deployment of [Sphinx search engine](http://sphinxsearch.com/).