Guide for Using IMacros to Pull Real Estate Records

Embed Size (px)

Citation preview

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    1/17

     

    Guide for Using iMacros to Pull Real Estate Records

    By Rick Dawson – www.taxsale.net  www.deedgrabber.com 

    http://www.taxsale.net/http://www.taxsale.net/http://www.taxsale.net/http://www.deedgrabber.com/http://www.deedgrabber.com/http://www.deedgrabber.com/http://www.taxsale.net/

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    2/17

     

    Setup (one time only):

    1.  Install iMacros and enter your Scripting license key (Help->Enter License Key)

    2.  Open iMacros. There are three file locations you need know about:

    •  Datasources

    • 

    : We will typically be looking up properties by parcel number. Thisfolder is where you will keep the lists of parcel numbers you want to look up.

    Downloads

    • 

    : This is where iMacros will save your results that it retrieved from theweb.

    Macros

     

    : This is where the macros you record will be stored. A macro is just a set ofinstructions for each website, telling iMacros what to retrieve. More on this later.

    I suggest setting the location of these three folders to somewhere convenient on yourcomputer. You will need to access all three regularly.

    I like to put each folder on my desktop for easy access. Here’s how you do that:

    In iMacros, go to Tools->Options->Paths tab. Here’s what you should see:

    Click the small file folder icon for each folder and navigate to your desktop. Then

    choose “Make new folder”. For Folder Macros create “IMMacros”. For FolderDataSources create “IMDatasources”. For Folder Downloads create “IMDownloads”.Click OK.

     Now you will know where to easily access these folders later, and you’ve programmed

    iMacros with where to find them as well.

    Setup (for each new county you want to run):

     File Preparation: 

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    3/17

    Step 1: Copy the parcel numbers from your existing list into a new spreadsheet or type them in

    manually into a new spreadsheet.

    Open your list and copy only the column of parcel numbers, and paste it into a new spreadsheet.

    Remove any column headings.

    Save this spreadsheet as File Type=CSV and name the file something you can remember. Iusually name mine “[County Name]parcels”.

    Save the file in the IMDatasources file you just created on your desktop.

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    4/17

     

    Create the Macro: 

    Step 1:  Locate the county website where you would like to pull data. For this example we will

    use the Lake County, Indiana Assessor’s website to get property information.

    This website is located at http://in-lake-assessor.governmaxa.com/propertymax/rover30.asp  

    Go to the website in a regular browser and see what is available on the site for a sample parcel

    number on your list. Decide what data you would like to retrieve, and become familiar with howto navigate in the site to view that data.

    For our example, let’s retrieve owner name and address, property type, assessed value, lot squarefootage/acreage, and improvement square footage.

    Step 2:  Record a one-time only macro. The macro is what tells iMacros where to go and what

    information you’d like to gather.

    Open iMacros and enter the county website in the address bar and navigate to where you would

    normally go to manually enter your parcel number.

     Next, click on the #Current.iim macro on the top left of the screen, click the Record tab, and clickthe record button that appears.

    Click the field where the parcel number is requested. Enter a sample parcel number from yourlist manually and click the appropriate search button. If the input area for the parcel number

    consists of several fields, be sure to click on each field before entering that part of the parcelnumber.

    http://in-lake-assessor.governmaxa.com/propertymax/rover30.asphttp://in-lake-assessor.governmaxa.com/propertymax/rover30.asphttp://in-lake-assessor.governmaxa.com/propertymax/rover30.asphttp://in-lake-assessor.governmaxa.com/propertymax/rover30.asp

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    5/17

     

    Then navigate to the page that contains the information you’re looking for. Some of the

    information you’re looking for may be available right on the first page. In that case stay on that page for now.

    Click the “Extraction Wizard” button when you’re on the first page containing data you want.The following box will appear:

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    6/17

     

    You are now ready to retrieve data from this page. I suggest retrieving the property parcelnumber first. This will give you a reference for the data you are about to pull, so you can be sureyou’re matching the right data with the right parcel number later.

    For each piece of data you want for the parcel that’s on this screen, click on that data with the

    mouse. Next, in the box labeled “ATTR:”, change the specific data found there to “*”. Click theFind POS button.

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    7/17

    Finally click “Test EXTRACT tag”, and a popup will tell you what you should expect to extractwith that command.

    Repeat for each additional field you want to pull. When you’ve pulled all the data for the pageyou want, click “Close”.

    You can again navigate in the website at this point – if there is more data you want on other pages, navigate to those pages and repeat the above process to get more data on each page.

    When you’ve used the extraction wizard to extract all the data you want to get, close the Wizardand navigate back to the beginning again. Usually you can do this by clicking a “New Search”,

    “New Parcel” link, or something similar. Click Stop on the Recording tab.

    You’re now done recording the macro.

    Step 3: Pre-edit the macro 

    Click on “#Current” in the macro list like you did last time, and click the edit tab and “Edit

    Macro” button. The macro will pop up in Notepad.

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    8/17

     

    Remove any lines that start with the “URL GOTO=…” Click File->Save in Notepad.

    Step 4: Test-play the macro

    Click “#Current” for the macro, then the Play tab and Play button.

    You should observe your sample parcel number being typed in, then a popup will show you thedata that iMacros is extracting. The navigation should return to where it started.

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    9/17

     

    You’re now ready to automate the macro to accept an unlimited number of parcel numbers.

    Step 5:  Modify the macro to accept your file of parcel numbers

    Again click the Edit tab and Edit Macro button so your macro appears in Notepad.

    Go to the end of the first line (begins with VERSION BUILD=…) and hit enter to create a blankline.

    Paste in the following code:

    SET !EXTRACT_TEST_POPUP NO

    SET !DATASOURCE filename.csvSET !DATASOURCE_LINE {{!LOOP}}

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    10/17

    Replace filename with the name of the parcel number-only file you created at the beginning.

    Step 6: Further modify the macro to insert parcel number and save results.

    At this point your macro should look something like this:

    It’s not really necessary to understand this code completely. We just want to recognize the majorsections of it.

    If the parcel number is entered all at once, in one field

    (skip this section if parcel number is broken up into several fields)

    Here we want to find the section of the macro where the parcel number is entered. We will justlook for the sample parcel number we typed in while recording the macro.

     Now we need to replace that number with the following:

    {{!COL1}}

    This tells the macro which column the parcel number is found in, in the datasource spreadsheetwe created.

    VERSION BUILD=7050969SET !EXTRACT_TEST_POPUP NOSET !DATASOURCE lakeparcels.csv

    SET !DATASOURCE_LINE {{!LOOP}}TAB T=1

    TAB CLOSEALLOTHERSFRAME NAME=body

    TAG POS=1 TYPE=INPUT:TEXT FORM=NAME:searchform ATTR=NAME:p.parcelid CONTENT={{!COL1}}TAG POS=1 TYPE=INPUT:SUBMIT FORM=NAME:searchform ATTR=NAME:go&&VALUE:GoTAG POS=43 TYPE=FONT ATTR=TXT:* EXTRACT=TXT

    TAG POS=44 TYPE=FONT ATTR=TXT:* EXTRACT=TXTTAG POS=52 TYPE=FONT ATTR=TXT:* EXTRACT=TXT

    FRAME NAME=bodyTAG POS=1 TYPE=A ATTR=TXT:ParcelNumber

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    11/17

    If the parcel number is entered in several pieces:

    Sometimes a county requires that a parcel number like 109-43-443 to be entered like this:

    As instructed earlier, when you record the macro, be sure to click on each field separately even ifthe cursor automatically jumps to the next field. The macro file will look a little different:

    Macro with single parcel number field:

    TAG POS=1 TYPE=INPUT:TEXT FORM=NAME:searchform ATTR=NAME:p.parcelid CONTENT={{!COL1}}

    Macro with several parcel number fields broken up:

    We will need to break up those parcel numbers in our Datasource spreadsheet, and enter eachsegment of the parcel number separately.

    First, replace each segment of the sample parcel number entered with {{!COL1}}, {{!COL2}},{{!COL3}}, etc:

    TAG POS=1 TYPE=INPUT:TEXT FORM=ID:form1 ATTR=ID:bookf CONTENT={{!COL1}}

    TAG POS=1 TYPE=INPUT:TEXT FORM=ID:form1 ATTR=ID:mapf CONTENT={{!COL2}}TAG POS=1 TYPE=INPUT:TEXT FORM=ID:form1 ATTR=ID:itemf CONTENT={{!COL3}}

    Then you’ll need to modify your parcel number file so it has the appropriate number of columns.

    Say this is our Datasources spreadsheet:

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    12/17

     

    We see that we need to enter 3 numbers of the parcel number in the first field, 2 in the second,

    and 3 in the third. Highlight the column and choose Data->Text to Columns. If you’re using anolder version of Excel this feature IS available but may be accessed slightly differently.

    In this case, we’ll choose “Fixed Width” because we know we want 3 digits, 2 digits, then 3digits.

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    13/17

     We’ll just click where we want to divide the number as shown, and click next and Finish.

    If there had been any zeros in the parcel numbers, we would have needed to take another step.Excel will cut off any leading zeros, and we want to restore those. See this example:

    For row one we would have wanted 108, 09, 566. There are also other columns with the leadingzero cut off.

    Highlight each column, right click, choose “Format Cells”, Custom.

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    14/17

    In the “Type:” box, type in zeros until the column reaches the proper width. In other words, ifthere are supposed to be 2 digits for the column, type “00”. If there are supposed to be 3, type

    “000”, and so on.

    Repeat this for each column. Now the sheet is how we want it:

    Resave the datasource file, make sure it’s CSV format, and in the proper location as discussed

     previously.

    Either Parcel Number Format – Resume Here

    The last thing we need to do is add a command to save the data we collect into a file. That

    command is:

    SAVEAS TYPE=EXTRACT FOLDER=* FILE=countynameresults.csv

    This will save your results file in the Downloads folder you created at the beginning. Replacecountyname with the name of the county you’re searching.

    VERSION BUILD=7050969SET !EXTRACT_TEST_POPUP NOSET !DATASOURCE lakeparcels.csvSET !DATASOURCE_LINE {{!LOOP}}

    TAB T=1TAB CLOSEALLOTHERSFRAME NAME=bodyTAG POS=1 TYPE=INPUT:TEXT FORM=NAME:searchform ATTR=NAME:p.parcelid CONTENT={{!COL1}}

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    15/17

    TAG POS=1 TYPE=INPUT:SUBMIT FORM=NAME:searchform ATTR=NAME:go&&VALUE:GoTAG POS=43 TYPE=FONT ATTR=TXT:* EXTRACT=TXTTAG POS=44 TYPE=FONT ATTR=TXT:* EXTRACT=TXT

    TAG POS=52 TYPE=FONT ATTR=TXT:* EXTRACT=TXTFRAME NAME=bodyTAG POS=1 TYPE=A ATTR=TXT:ParcelNumberSAVEAS TYPE=EXTRACT FOLDER=* FILE=lakeresults.csv

     NOTE: Delete or rename the countynameresults.csv file in the Downloads folder anytime you

    run the macro again, including if you have to correct something with it. Otherwise iMacros willcontinue to write in the file and it can get confusing. Also, never have the countynameresults.csvfile open in Excel when you run the macro, or it will not be able to write to the file.

    Save your macro and give it name.

    Filename: countynamemacro.iimFile Type: Any

    Just about done!

    Step 7:  Run the macro and get results

    It’s time to gather the data.

    Refresh the macro list so your macro now appears:

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    16/17

     

    Select your macro and go to the play tab:

    Manually navigate the browser to where you need to start your search, and enter the number ofrecords in your parcel number files (the number of times iMacros needs to loop through).

  • 8/19/2019 Guide for Using IMacros to Pull Real Estate Records

    17/17

     

    Click Play(Loop)

    Step 8:  Retrieve your results file

    Once iMacros has completed running, open the file “countynameresults.csv” in yourIMDownloads folder your created earlier.

    If you followed my suggestion, the first column will contain the parcel number followed by theadditional information you wanted:

    Copy and paste this information right next to your original list and make sure the parcel numbersmatch up.

     Now you can filter your list!

    Make sure to rename your results file (perhaps add a date to it?) and delete the old results file sonext time you run the macro there is a blank file to start with again.