Integrate NGINX EventTracker v8.x and above

Publication Date: April 11, 2018

1

Integrate NGINX

Abstract This guide provides instructions to forward syslog generated by NGINX to EventTracker. EventTracker is configured to collect and parse these logs to generate reports.

Scope The configurations detailed in this guide are consistent with EventTracker Enterprise version 8.x and later, and NGINX installed on Linux Operating System.

Audience IT Admins, NGINX administrators and EventTracker users who wish to forward logs to EventTracker Manager and monitor events using EventTracker Enterprise.

The information contained in this document represents the current view of EventTracker. on the issues discussed as of the date of publication. Because EventTracker must respond to changing market conditions, it should not be interpreted to be a commitment on the part of EventTracker, and EventTracker cannot guarantee the accuracy of any information presented after the date of publication.

This document is for informational purposes only. EventTracker MAKES NO WARRANTIES, EXPRESS OR IMPLIED, AS TO THE INFORMATION IN THIS DOCUMENT.

Complying with all applicable copyright laws is the responsibility of the user. Without limiting the rights under copyright, this paper may be freely distributed without permission from EventTracker, if its content is unaltered, nothing is added to the content and credit to EventTracker is provided.

EventTracker may have patents, patent applications, trademarks, copyrights, or other intellectual property rights covering subject matter in this document. Except as expressly provided in any written license agreement from EventTracker, the furnishing of this document does not give you any license to these patents, trademarks, copyrights, or other intellectual property.

The example companies, organizations, products, people and events depicted herein are fictitious. No association with any real company, organization, product, person or event is intended or should be inferred.

© 2018 EventTracker Security LLC. All rights reserved. The names of actual companies and products mentioned herein may be the trademarks of their respective owners.

2

Integrate NGINX

Table of Contents

Abstract .................................................................................................................................................................... 1

Scope ........................................................................................................................................................................ 1

Audience .................................................................................................................................................................. 1

Overview ...................................................................................................................................................................... 3

Prerequisites ................................................................................................................................................................ 3

Configure NGINX to forward logs to EventTracker ................................................................................................... 3 Configuration to enable Syslog forwarding ........................................................................................................... 3

Configuring nginx.conf ........................................................................................................................................ 3

Configuring rsyslog.conf ..................................................................................................................................... 4

EventTracker Knowledge Pack (KP) ............................................................................................................................ 4 Categories ................................................................................................................................................................ 4

Reports ..................................................................................................................................................................... 4

Import Knowledge Pack into EventTracker................................................................................................................ 8 Import Categories .................................................................................................................................................... 8

Import Knowledge Objects ................................................................................................................................... 10

Import Token Templates ....................................................................................................................................... 11

Import Flex Reports ............................................................................................................................................... 12

Verify Knowledge Pack in EventTracker ................................................................................................................... 14 Verify Category ...................................................................................................................................................... 14

Verify Knowledge Object ...................................................................................................................................... 14

Verify Token Templates ........................................................................................................................................ 15

Verify Flex Reports ................................................................................................................................................ 15

Create Dashboards in EventTracker ......................................................................................................................... 16 Schedule Reports ................................................................................................................................................... 16

Create Dashlet ....................................................................................................................................................... 18

Import Dashlet ....................................................................................................................................................... 20

Sample Dashboards ................................................................................................................................................... 23

3

Integrate NGINX

Overview NGINX is a web server which can also be used as a reverse proxy, load balancer and HTTP cache. EventTracker integrates with NGINX using Syslog and provides reports and knowledge objects.

Prerequisites • EventTracker v8.x or above should be installed. • Allow port 514 in the firewall on the Nginx server system.

Configure NGINX to forward logs to EventTracker NGINX supports forwarding logs to EventTracker via syslog.

Configuration to enable Syslog forwarding To configure syslog forwarding we need to configure NGINX.conf and rsyslog.conf as shown below.

Configuring nginx.conf • Edit the NGINX.conf file using the following command:

vi /etc/nginx/nginx.conf • In the nginx.conf file scroll to logging settings and add the following lines.

access_log syslog:server=Eventracker_server_IP:514,facility=local7,tag=Nginx; error_log syslog:server=Eventracker_server_IP:514,facility=local7,tag=Nginx;

• Save and exit.

Figure 1

4

Integrate NGINX

Configuring rsyslog.conf

• Edit the rsyslog.conf file using the following command: vi /etc/rsyslog.conf

• In the rsyslog.conf file scroll to the bottom and add the following line. local7.debug /var/log/nginx/access.log; RemoteFormat local7.debug /var/log/nginx/error.log; RemoteFormat

• Save and exit. • Restart the rsyslog services by running the following command:

Sudo /etc/init.d/rsyslog restart

Figure 2

• This will ensure the logs are forwarded to EventTracker.

EventTracker Knowledge Pack (KP) Once logs are received into EventTracker, Categories and Reports can be configured into EventTracker. The following Knowledge Packs are available in EventTracker Enterprise.

Categories Nginx web server -Access logs: This category provides information related to all access logs generated.

Nginx web server -Error logs: This category provides information related to all error logs generated.

Reports Nginx web server -Access logs: These reports provide information about all access logs generated.

5

Integrate NGINX

Figure 3

Logs considered:

Figure 4

Nginx web server – Server errors: These reports provide information about all error logs generated.

Figure 5

6

Integrate NGINX

Logs considered:

Figure 6

Nginx web server - Client errors: These reports provide information about access logs with bad request (error code 4XX).

Figure 7

Logs considered:

Figure 8

Nginx web server - SQL injection: These reports provide information about the user request which are suspicious with respect to SQL injection.

7

Integrate NGINX

Figure 9

Logs considered:

Figure 10

Nginx web server – Cross site scripting: These reports provide information about the user request which are suspicious with respect to Cross Site Scripting.

Figure 11

8

Integrate NGINX

Logs considered:

Figure 12

Import Knowledge Pack into EventTracker NOTE: Import knowledge pack items in the following sequence:

• Categories • Knowledge Objects • Alerts • Token Templates • Flex Reports

NOTE: Export knowledge pack items in the following sequence:

• Categories • Knowledge Objects • Alerts • Token Templates • Flex Reports

Import Categories • Launch EventTracker Control Panel.

9

Integrate NGINX

Figure 13

• Double click Export Import Utility, and then click the Import tab.

• Click Category option, and then click the browse button.

Figure 14

• Locate the Categories_NGINX.iscat file, and then click the Open button.

• To import categories, click the Import button.

EventTracker displays success message.

10

Integrate NGINX

Figure 15

• Click OK, and then click the Close button.

Import Knowledge Objects • Click Knowledge objects under Admin option in the EventTracker Manager page.

• Click Browse.

• Locate the KO_NGINX.etko file

Figure 16

• Now select all the files and then click on Upload.

Figure 17

11

Integrate NGINX

Knowledge objects are now imported successfully.

Figure 18

Import Token Templates • Logon to EventTracker Enterprise.

• Click the Admin menu, and then click Parsing Rules.

Figure 19

• Select Template tab, browse to select the Token_Template_NGINX.ettd file

• Click on the Import icon.

Figure 20

12

Integrate NGINX

Figure 21

• Templates are now imported successfully.

Figure 22

Import Flex Reports • Launch EventTracker Control Panel. • Double click Export Import Utility, and then click the Import tab.

Figure 23

• Click Reports option, and select new (.etcrx) from the option.

13

Integrate NGINX

Figure 24

• And then browse the file.

Figure 25

• Locate the file named FlexReports_NGINX.etcrx and select all the check box. • Click the Import button to import the reports. EventTracker displays success message.

14

Integrate NGINX

Figure 26

Verify Knowledge Pack in EventTracker Verify Category

1. Logon to EventTracker Enterprise.

2. Click the Admin menu, and then click Category.

3. In Category Group Tree to view imported category, scroll down and click NGINX group folder.

Categories are displayed in the pane.

Figure 27

Verify Knowledge Object 1. Logon to EventTracker Enterprise.

2. Click the Admin menu, and then click Knowledge Object.

15

Integrate NGINX

3. In Knowledge Object Group Tree to view imported knowledge object, scroll down and click Nginx

web server group folder.

Knowledge Object are displayed in the pane.

Figure 28

Verify Token Templates 1. Logon to EventTracker Enterprise.

2. Click the Admin menu, and then click Parsing Rules.

3. In Parsing Rules select Template, scroll down and click Nginx web server group folder

Token templates are displayed in the pane.

Figure 29

Verify Flex Reports 1. Logon to EventTracker Enterprise.

2. Click the Reports menu, and then Configuration.

16

Integrate NGINX

3. Select Defined in report type.

4. In Report Groups Tree to view imported Scheduled Reports, scroll down and click Nginx web server

group folder.

Figure 30

5. Reports are displayed in the Reports configuration pane.

NOTE: Please specify appropriate systems in report wizard for better performance.

Create Dashboards in EventTracker NOTE: This is applicable for EventTracker 8.x and for EventTracker 9.x import the dashboards(.etwd file).

Schedule Reports 1. Open EventTracker in browser and logon.

Figure 31

2. Navigate to Reports>Configuration.

17

Integrate NGINX

Figure 32

3. Select Nginx in report groups. Check Defined dialog box.

4. Click on ‘schedule’ to plan a report for later execution.

5. Choose appropriate time for report execution and in Step 8 check Persist data in Eventvault explorer box.

Figure 33

6. Check column names to persist using PERSIST checkboxes beside them. Choose suitable Retention period.

18

Integrate NGINX

7. Proceed to next step and click Schedule button. 8. Wait for scheduled time or generate report manually.

Create Dashlet 1. Open EventTracker in browser and logon.

Figure 35

2. Navigate to Dashboard> Flex Dashboard pane is shown.

Figure 36

3. Click to add a new dashboard. Flex Dashboard configuration pane is shown.

19

Integrate NGINX

Figure 37

4. Fill fitting title and description and click Save button.

5. Click to configure a new flex dashlet. Widget configuration pane is shown.

Figure 38

6. Locate earlier scheduled report in Data Source dropdown. 7. Select Chart Type from dropdown.

20

Integrate NGINX

8. Select extent of data to be displayed in Duration dropdown. 9. Select computation type in Value Field Setting dropdown. 10. Select evaluation duration in As Of dropdown. 11. Select comparable values in X Axis with suitable label. 12. Select numeric values in Y Axis with suitable label. 13. Select comparable sequence in Legend. 14. Click Test button to evaluate.

Evaluated chart is shown. 15. If satisfied, Click Configure button.

16. Click ‘customize’ to locate and choose created dashlet.

17. Click to add dashlet to earlier created dashboard.

Import Dashlet In EventTracker 9.0, we have added new feature which will help to import/export of dashlet. Following is procedure to do that:

1. Login into EventTracker Enterprise Web console.

Figure 39

2. Go to My Dashboard option.

21

Integrate NGINX

Figure 40

3. Click on import button and select .etwd File.

Figure 41

4. Click upload and select Dashboard which you want to import.

22

Integrate NGINX

Figure 42

5. Click on Import button. It will upload all selected dashboard.

Figure 42

23

Integrate NGINX

Sample Dashboards

• REPORT: Nginx Web Server – Access logs WIDGET TITLE: Nginx Web Server – Client request CHART TYPE: Line AXIS LABELS [X-AXIS]: Source IP Address

Figure 43

• REPORT: Nginx Web Server – Access logs WIDGET TITLE: Nginx Web Server – User agents CHART TYPE: Stacked column AXIS LABELS [X-AXIS]: User agents

Figure 44

24

Integrate NGINX

• REPORT: Nginx Web Server – Access logs WIDGET TITLE: Nginx Web Server – Http Response codes CHART TYPE: Stacked column AXIS LABELS [X-AXIS]: Source IP Address

Figure 45