Start Your Search Engines: Optimizing Solr to Improve Results

Preview:

DESCRIPTION

Advanced troubleshooting and optimization techniques to improve solr search results.

Citation preview

SOLR Facts

65% of IT organizations were able to reduce the costs of developing and deploying their search application by 50% or more as a result of using SOLR

Source: Survey of 26 Solr/Lucene users conducted by TechValidate

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 1

SOLR Facts

43% of IT organizations index or update 1,000,001 to 5,000,000 or more documents each week with SOLR.

Source: Survey of 26 Solr/Lucene users conducted by TechValidate

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 2

43%

SOLR Facts

“We were able to decrease risk by allowing our catalog of 6 million- plus items and 50 million user profiles to be searched well beyond the possibilities with MySQL.”

Source: Executive, Small Business Computer Software Company

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 3

SOLR Facts

“With SOLR’s Dis-Max query parser, we were able to drastically increase the relevance of returned search results.”

Source: IT Architect, Small Business Media & Entertainment Company

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 4

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 5

Click to edit Master title style

04/10/2023

© 2011 Crown Partners. All Rights Reserved. 5

SOLR

Presented by: Rob Miller, Jason Grim & Ryan Street08/15/2012

Optimizing SOLR to Improve Search

About Crown

Certified Magento Development Team

SOLR experts in Advanced Search

Integration between SOLR and Magento, ERP

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 6

Agenda

Overview of SOLR

Basic Solr Troubleshooting

– Common SOLR Troubleshooting and Solutions

Advanced optimization of search results

– Making changes in Solr configuration to better your results.

Improving search speed

– Optimizing to improve search speed.

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 7

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 8

Crown’s First SOLR Webinar

Crown’s SOLR 1.0 Webinar

– Support for Spelling/Synonyms/Stop Words

– Improved Layered Navigation

– September 21, 2011

– http://bit.ly/solrmagentowebinar

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 9

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 10

Basic Troubleshooting

Useful SOLR Tools

Web Interface

Luke

Command Line

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 11

Magento Cannot Connect to SOLR

Do you have the right URL and Port?

Does Your server communicate SOLR and Magento?

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 12

Magento and Solr Show Bad or No Results

Bad Data

Change from Final to Partial Commit

Look into the command line for critical errors during index

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 13

Where to find more answers…

Magento Forums

– http://www.magentocommerce.com/boards/

Magento Answers

– http://www.magentocommerce.com/answers/welcome

Dr. Gento

– http://www.drgento.com

And of course… Crown!

– http://www.crownpartners.com/

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 14

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 15

Advanced Optimization of Search Results

Configuration: Minimum Must Match

Must Match Formats

– 2

– 75%

– 2<-25%

– 2<-1 5<80%

Setting is language specific

Will NOT require Reindex (Query time parameter)

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 16

Query Boosting Results

Boost individual product attributes

Query time configuration

Language specific

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 17

Where to Find More Answers

Apache’s Wiki

– http://wiki.apache.org/solr/

Dr. Gento

– http://www.drgento.com

And of course… Crown!

– http://www.crownpartners.com/

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 18

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 19

Improving Search Speed

SOLR and Magento Relationship

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 20

User submits a search query

Magento connects to SOLR and sends over query

SOLR processes query and returns Magento Product IDs

Magento loads the product IDs and displays them to the user

Is SOLR the Problem?

Check qtime of a query

– /select params={…} hits=79 status=0 QTime=48

Solr Performance Enhancements

– http://wiki.apache.org/solr/SolrPerformanceFactors

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 21

MySQL Optimization

Update your version of MySQL to the latest version

Make sure your MySQL settings are tuned per Magento’s recommendations

– http://www.magentocommerce.com/whitepaper/

Using the Memory (HEAP) Storage Engine for Temp Tables

– http://dev.mysql.com/doc//refman/5.0/en/memory-storage-engine.html

Leverage MySQL query caching

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 22

Where to Find More Answers

Magento Forums

– http://www.magentocommerce.com/boards/

Magento U Performance and Optimization for System Administrators

– http://www.magentocommerce.com/services/training

Dr. Gento

– http://www.drgento.com

And of course… Crown!

– http://www.crownpartners.com/

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 23

Questions?

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 24

Thank You!

Rob Millerrmiller@crownpartners.com

Jason Grimjgrim@crownpartners.com

Ryan Streetrstreet@crownpartners.com

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 25

Recommended