Migrate Logs to a New M-Series Appliance in Log Collector Mode

1. Perform initial setup of the new M-Series appliance that will be a Dedicated Log Collector.

   1. Rack mount the M-Series appliance. Refer to the M-Series Appliance Hardware Reference Guides for instructions.
   2. Perform Initial Configuration of the M-series appliance.

      When configuring interfaces, configure only the Management (MGT) interface. Switching to Log Collector mode (later in this procedure) removes the configurations for any other interfaces. If the Log Collector will use interfaces other than MGT, add them when configuring the Log Collector (see Step 2).
   3. Register Panorama.
   4. Purchase and activate the Panorama support license or transfer licenses as follows only if the new M-Series appliance is the same hardware model as the old M-Series appliance. If the new M-Series appliance is a different model than the old M-Series appliance, you must purchase new licenses.

      1. Log in to the Palo Alto Networks Customer Support web site.
      2. Select the Assets tab and click the Spares link.
      3. Click the Serial Number of the new M-Series appliance.
      4. Click Transfer Licenses.
      5. Select the old M-Series appliance and click Submit.
   5. Activate a firewall management license. If you are migrating from an M-200 appliance to a M-600 appliance, enter the auth-code associated with the migration license.
   6. Install Content and Software Updates for Panorama. For important details about software versions, see Panorama, Log Collector, Firewall, and WildFire Version Compatibility.
   7. Switch from Panorama mode to Log Collector mode:

      1. Access the Log Collector CLI and switch to Log Collector mode:

         > request system system-mode logger 

      2. Enter Y to confirm the mode change. The M-Series appliance reboots. If the reboot process terminates your terminal emulation software session, reconnect to the M-Series appliance to display the Panorama login prompt.
         If you see a CMS Login prompt, press Enter without typing a username or password.
   8. Use the Log Collector CLI to enable connectivity between the Log Collector and Panorama management server. <IPaddress1 is for the MGT interface of the primary Panorama and <IPaddress2> is for the MGT interface of the secondary Panorama.

      > configure  
      # set deviceconfig system panorama-server <IPaddress1> panorama-server-2 <IPaddress2>  
      # commit  
      # exit  

2. On the Panorama management server, add the new Log Collector as a managed collector.

   For all steps with commands that require a serial number, you must type the entire serial number; pressing the Tab key won’t complete a partial serial number.

   1. Configure the Log Collector as a managed collector using the Panorama web interface or using the following CLI commands:

      > configure  
      # set log-collector <LC_serial_number> deviceconfig system hostname <LC_hostname>  
      # exit  

      If the old Log Collector used interfaces other than the MGT interface for log collection and Collector Group communication, you must define those interfaces on the new Log Collector when you configure it as a managed collector (PanoramaManaged CollectorsInterfaces).
   2. Commit your changes to Panorama. Don’t commit the changes to the Collector Group just yet.

      > configure  
      # commit  
      # exit  

   3. Verify that the Log Collector is connected to Panorama and that the status of its disk pairs is present/available.

      > show log-collector serial-number <log-collector_SN>

      The disk pairs will display as disabled at this stage of the restoration process.
3. Remove the RAID disks from the old Log Collector.

   1. Power off the old Log Collector by pressing the Power button until the system shuts down.
   2. Remove the disk pairs. For details, refer to the disk replacement procedure in the M-Series Appliance Hardware Reference Guides.
4. Prepare the disks for migration.

   Generating the metadata for each disk pair rebuilds the indexes. Therefore, depending on the data size, this process can take a long time to complete. To expedite the process, you can launch multiple CLI sessions and run the metadata regeneration command in each session to complete the process simultaneously for every pair. For details, see Regenerate Metadata for M-Series Appliance RAID Pairs.

   1. Insert the disks into the new Log Collector. For details, refer to the disk replacement procedure in the M-Series Appliance Hardware Reference Guides.

      The disk carriers of the M-200 appliance are incompatible with those of the M-600 appliance. Therefore, when migrating between these hardware models, you must unscrew each disk from its old carrier and insert the disk in the new carrier before inserting the disk in the new appliance.

      You must maintain the disk pair association. Although you can place a disk pair from slot A1/A2 on the old appliance into slot B1/B2 on the new appliance, you must keep the disks together in the same slot; otherwise, Panorama might not restore the data successfully.
   2. Enable the disk pairs by running the following CLI command for each pair:

      > request system raid add <slot> force no-format

      For example:

      > request system raid add A1 force no-format 
      > request system raid add A2 force no-format 

      The force and no-format arguments are required. The force argument associates the disk pair with the new Log Collector. The no-format argument prevents reformatting of the drives and retains the logs stored on the disks.
   3. Generate the metadata for each disk pair.

      > request metadata-regenerate slot <slot_number>

      For example:

      > request metadata-regenerate slot 1

5. Add a Log Collector with no disks to a Collector Group.

   From this point, only commits that are required to complete the migration process on Panorama and the Log Collectors. Hold off making any other changes.

   1. Access the Panorama CLI.
   2. Overwrite Panorama restriction to allow Log Collector with no disk to be added to a Collector Group: request log-migration-set-start
6. Migrate the logs.

   You must use the Panorama CLI for this step, not the web interface.

   You must assign the new Log Collector to the Collector Group that contains the old Log Collector.

   1. Assign the new Log Collector to the Collector Group and commit your changes to Panorama.

      > configure 
      # set log-collector-group <collector_group_name> logfwd-setting collectors <new_LC_serial_number> 
      # commit 
      # exit 

   2. For each disk pair, migrate the logs from the old Log Collector to the new Log Collector and attach the disk pair to the new Log Collector.

      > request log-migration from <old_LC_serial_number> old-disk-pair <log_disk_pair> to <new_LC_serial_number> new-disk-pair <log_disk_pair> 

      For example:

      > request log-migration from 003001000010 old-disk-pair A to 00300100038 new-disk-pair A 

7. Reconfigure the Collector Group.

   1. Use the web interface to assign the new Log Collector to the firewalls that forward logs (PanoramaCollector GroupsDevice Log Forwarding). Give the new Log Collector the same priority in the firewall preference lists as the old Log Collector.

      You cannot use the CLI change the priority assignments of firewall preference lists.
   2. Delete the old Log Collector from the Collector Group.

      > configure 
      # delete log-collector-group <group_name> logfwd-setting collectors <old_LC_serial_number> 

      For example:

      # delete log-collector-group DC-Collector-Group logfwd-setting collectors 003001000010

   3. Delete the old Log Collector from the Panorama configuration and commit your changes to Panorama.

      # delete log-collector <old_LC_serial_number> 
      # commit 
      # exit 

   4. Commit the Collector Group changes so that the managed firewalls can send logs to the new Log Collector.

      > commit-all log-collector-config log-collector-group <collector_group_name>

      For example:

      > commit-all log-collector-config log-collector-group DC-Collector-Group

8. Generate new keys on the new Dedicated Log Collector.

   This command is required in order to add the new Log Collector to the Collector Group and should only be run for the Collector Group of the Log Collector being replaced. This step deletes the existing RSA keys and allows Panorama to create new RSA keys.

   1. Access the Panorama CLI.
   2. Delete all RSA keys on new Log Collector:

      request logdb update-collector-group-after-replace collector-group <collector-group-name>

      The process can take up to 10 minutes to completed.
9. Confirm that SearchEngine Status is Active for all Log Collectors in the Collector Group.

   Do not continue until SearchEngine Status is Active for all Log Collectors in the Collector Group. This will result in purging of logs from the Log Collector being replaced.

   1. Access the Panorama CLI.
   2. Show the Log Collector details by running the following commands either:

      • On Panorama for all Log Collectors:
        show log-collector all

      Alternatively, you can run the following command on each Dedicated Log Collector:

      show log-collector detail

   3. Confirm that SearchEngine Status is Active.

      Redistribution status:       none

      Last commit-all: commit succeeded, current ring version 1

      SearchEngine status:     Active

      md5sum 4e5055a359f7662fab8f8c4f57e24525 updated at 2017/06/14 09:58:19

10. On the new Log Collector, replace previous Log Collector serial number with the new Log Collector serial number.

    You must replace the old Log Collector serial number with the new Log Collector serial number so that the new Log Collector will not run in to purging issues, resulting in the Log Collector being unable to purge old data from the migrated logs when necessary.

    (PAN-OS 11.1 and later releases) When the Log Collector serial number changes, you must erase all Elasticsearch data before executing the logger update command. If you skip this step, Elasticsearch will not start correctly after the migration.

    1. Access the Log Collector CLI.
    2. Erase all existing Elasticsearch data on the new Log Collector:

       debug elasticsearch erase data
    3. Replace old Log Collector serial number with new Log Collector serial number:

       request log-migration-update-logger from <old-log-collector-serial-number> to <new-log-collector-serial-number>
    4. Reingest raw logs for each required log type and time window. Repeat the command for each log type and monitor progress before initiating the next. debug logdb migrate-lc start log-type <log-type> time period start-date <YYYY/MM/DD> end-date <YYYY/MM/DD>