Collecting Tech Support Logs in Avi Vantage

Tech support logs are used for offline troubleshooting. This article describes how to collect tech support logs from a single Avi Controller or 3-node Avi Controller cluster. If you are running Avi Vantage 18.2.4 or lower, refer instead to this article.

A complete list of tech support log types are listed in the last section of this article. Support personnel most often request the debuglogs, serviceengine, or virtualservice types.

Note: In a 3-node Avi Controller cluster, the steps mentioned in this article automatically collect logs from all the three nodes. The commands need not be entered separately on each Avi Controller node.

Collecting Tech Support Logs Using the Avi UI

Follow the instructions in this section to collect tech support logs using the Avi UI.

  1. Navigate to Administration > System > Tech Support and click on Generate Tech Support to begin.

    Tech Support

  2. The below screen will appear. It will reveal just one Type.

    Initial generate tech support screen

  3. Click on the drop-down icon at the right end of the Type field to reveal part of a list of choices for Type. Scroll for more choices.

    part of the drop-down

  4. Some types require no further specification; they are Clustering, Metrics Logs, Debug Logs, Placement, Portal, and Upgrade. For example, if Placement is chosen, a pair of messages will appear in succession, as below:

    First wait message

    Second wait message

    The image below illustrates how a set of tech support logs accumulated over time might appear in the table.

    Table of stored tech support files

    The image below shows some collections can complete with errors, details of which are revealed if the + (plus) sign within the row at extreme right is clicked.

    Table of stored tech support files

  5. After the support log archive has been created, a corresponding row will be added to the window’s table. Clicking the plus (+) sign at the right of a particular row yields an expanded view of the support log that includes the file name of the archive.

    Row created for the Placement log file

  6. Three options — trash the archive, download the archive, and expand/collapse the row entry — can be selected by choosing one of three icons at the right of the row.

  7. Some types do require further specification; they are GSLB, Pool, Virtual Service, and Service Engine. For example, if the Service Engine type is selected, the below screen appears. Note that the Cloud Selection and Service Engine Instance fields appear, the latter being mandatory.

    Service Engine type log selected

  8. Downloaded .tar.gz files should be conveyed to Avi Support for further troubleshooting.

Collecting Tech Support Logs Using the Avi CLI

Follow the instructions in this section to collect tech support logs using the Avi CLI.

  • In an Avi Controller cluster, one of the nodes is the leader or the primary node. Login to the leader node using any ssh client, such as putty. 10.10.1.1 is the leader node in this example.

login as: admin

Avi Cloud Controller

Avi Networks software, Copyright (C) 2013-2017 by Avi Networks, Inc.
All rights reserved.

Version:      17.1.6
Date:         2017-08-30 15:35:21 UTC
Build:        9022
Management:   10.10.2.2/22                UP
Gateway:      10.10.2.1                   UP

admin@10.10.1.1's password:

To know more about the leader node in an Avi Controller cluster, refer to Overview of the Controller Cluster. To know more about SSH key generation, refer to Avi CLI access.

  • Type shell command, and enter your credentials.

admin@avi-cntrl1:~$ shell
Login: admin
Password:
  • From the shell prompt, run the command show tech-support serviceengine.

    The command show tech-support serviceengine create debug logs for the particular SE.

    Note: For reference, Avi-cluster1-SE1 is the Avi SE for which we want to collect the debug logs.


[admin:avi-cntrl1]: > show tech-support serviceengine Avi-cluster1-SE1
  • This command generates core files and other debug logs, which are stored in /var/lib/avi/tech_support directory on the Avi Controller leader node. Use cd command from the Avi CLI to get access to the directory. Check the debug logs and the other log files, which are available in compressed form with tar.gz extension.

Sample tech support log file: debuglogs.20170915-124030.tar.gz The number 20170915 in the log file debuglogs.20170915-124030.tar.gz represents the date of generation of the log files, i.e., 15 Sep 2017.

The following are the ten available options that can be used while executing the show tech-support command.


[admin:cntrl]: > show tech-support
clustering       show system tech clustering
debuglogs        show system tech support
gslb             Collect GSLB logs on this site
metricslogs      show system tech metrics
pool             show system tech pool
placement        show system tech placement
portal           show system tech portal
serviceengine    show se tech-support
upgrade          show system tech upgrade
virtualservice   show vs tech-support
[admin:cnrl]: > 

Collecting Tech Support Logs Using Avi API

Execute the following command to collect tech support logs using REST API.

GET https:///api/techsupport/debuglogs
 

Using Tech Support API v2

Starting with Avi Vantage release 18.2.2, API version 2 (v2 API) is available for collecting tech support logs.

Notes:

  • Tech support v2 API is not blocking in nature. The v1 API is blocking in nature. The v1 API blocks the access of the device until the tech support collection completes. On average, the tech support collection takes more than five to six minutes. This duration is dependent on the number of cluster nodes, number of log files, bandwidth, etc. Because of this duration, the CLI timeout and timeout intervals are increased to capture tech support logs successfully using v1 API.

  • v1 APIs are not deprecated. You can still use the blocking API (VI API) in your scripts as required.

The following are few of the API methods which are used to collect tech support logs:

  • Use the following API call to collect tech support logs.

GET api/techsupportv2/debuglogs
  • Use the following API call to collect logs tech support logs for a specific SE instance.

api/techsupportv2/serviceengine/<SE Id>
  • Use the following API call to check the status of tech support collection. The following API indicates the path for tech support tarball (files)and the current status.

GET api/techsupportstatusv2
  • Use the following API call to download the tech support files.

GET api/fileservice?uri=controller://tech_support

Additional Information

The following command collects the debug logs on each of the Avi Controller nodes. This option keeps the collected tech support bundle to a minimal size. The option is especially useful if the core archive bundles that are present have already been uploaded and fixed.

show tech-support debuglogs

What Data Are Collected in Tech Support Logs

As the Avi Vantage system has evolved functionally over time, so too have the number of tech support log types and the data captured in each. Ten tech support types appear below. The debuglogs type captures Controller-specific debugging data; all other types capture data associated with their self-explanatory name.

  1. clustering
  2. metricslogs
  3. debuglogs
  4. placement
  5. portal
  6. serviceengine
  7. upgrade
  8. virtualservice
  9. gslb
  10. pool

The logs collected through the shell command show tech-support debuglogs contains all the relevant Controller logs from the previous and current partition from all the nodes in the cluster; this command is a superset of other show tech-support [clustering, upgrade, placement, portal, metricslogs, gslb] commands.

The two exceptions are

  1. show tech-support virtualservice </code> collects the additional show-command output listed below for a given virtual service, along with SE logs for SEs onto which the virtual service has been placed, and the Controller logs from all the nodes in the current partition.
  • show virtualservice
  • show virtualservice <key>
  • show virtualservice <key> detail
  • show virtualservice <key> tcpstat
  • show virtualservice <key> dnstable
  • show virtualservice <key> internal
  • show virtualservice <key> httpstats
  • show virtualservice <key> dosstat
  • show shardserver
  1. show tech-support pool </code> collects the additional show-command output listed below for a given pool, along with SE logs for SEs onto which the virtual service has been placed, and the vs_mgr logs from all the Controller nodes in the current partition.
  • show pool
  • show pool <key> algo
  • show pool <key> connpool
  • show pool <key> connpool filter disable_aggregate se
  • show pool <key> debug - show pool <key> detail
  • show pool <key> detail filter disable_aggregate se
  • show pool <key> internal
  • show pool <key> internal filter disable_aggregate se
  • show pool <key> httpcache
  • show pool <key> httpcache filter disable_aggregate se
  • show pool <key> httpcachestats
  • show pool <key> httpcachestats filter disable_aggregate se
  • show pool <key> persistence
  • show pool <key> persistence filter disable_aggregate se
  • show pool <key> hmon
  • show pool <key> summary
  • show pool <key> vs
  • show pool <key> server detail
  • show pool <key> server detail filter disable_aggregate se
  • show pool <key> server summary
  • show pool <key> server internal
  • show pool <key> server internal filter disable_aggregate se
  • show pool <key> server hmonstat
  • show pool <key> server hmonstat filter disable_aggregate se

If it is clear to the system administrator that a problem is associated with a particular virtual service, then capturing the virtualservice tech support log specific to that VS is best. Otherwise, the combination of debuglogs and serviceengine tech support logs is generally best.