Migrate Logs to a New M-Series Appliance in Log Collector Mode

If you need to replace an M-500 or M-100 appliance in Log Collector mode (Dedicated Log Collector), you can migrate the logs it collected from firewalls by moving its RAID disks to a new M-Series appliance. This procedure enables you to recover logs after a system failure on the M-Series appliance or to migrate logs as part of a hardware upgrade (from an M-100 appliance to an M-500 appliance).
  1. Perform initial setup of the new M-Series appliance that will be a Dedicated Log Collector.
    1. Rack mount the M-Series appliance. Refer to the M-100 or M-500 Appliance Hardware Reference Guide for instructions.
    2. When configuring interfaces, configure only the Management (MGT) interface. Switching to Log Collector mode (later in this procedure) removes the configurations for any other interfaces. If the Log Collector will use interfaces other than MGT, add them when configuring the Log Collector (see Step 2).
    3. Purchase and activate the Panorama support license or transfer licenses as follows only if the new M-Series appliance is the same hardware model as the old M-Series appliance. If the new M-Series appliance is a different model than the old M-Series appliance, you must purchase new licenses.
      1. Select the
        Assets
        tab and click the
        Spares
        link.
      2. Click the Serial Number of the new M-Series appliance.
      3. Click
        Transfer Licenses
        .
      4. Select
        the old M-Series appliance and click
        Submit
        .
    4. Activate a firewall management license. If you are migrating from an M-100 appliance to an M-500 appliance, enter the auth-code associated with the migration license.
    5. Switch from Panorama mode to Log Collector mode:
      1. Access the Log Collector CLI and switch to Log Collector mode:
        >
        request system system-mode logger
      2. Enter
        Y
        to confirm the mode change. The M-Series appliance reboots. If the reboot process terminates your terminal emulation software session, reconnect to the M-Series appliance to display the Panorama login prompt.
        If you see a
        CMS Login
        prompt, press Enter without typing a username or password.
    6. Use the Log Collector CLI to enable connectivity between the Log Collector and Panorama management server. <IPaddress1 is for the MGT interface of the primary Panorama and <IPaddress2> is for the MGT interface of the secondary Panorama.
      >
      configure
      #
      set deviceconfig system panorama-server
      <IPaddress1>
      panorama-server-2
      <IPaddress2>
      #
      commit
      #
      exit
  2. On the Panorama management server, add the new Log Collector as a managed collector.
    For all steps with commands that require a serial number, you must type the entire serial number; pressing the Tab key won’t complete a partial serial number.
    1. Configure the Log Collector as a managed collector using the Panorama web interface or using the following CLI commands:
      >
      configure
      #
      set log-collector
      <LC_serial_number>
      deviceconfig system hostname
      <LC_hostname>
      #
      exit
      If the old Log Collector used interfaces other than the MGT interface for log collection and Collector Group communication, you must define those interfaces on the new Log Collector when you configure it as a managed collector (
      Panorama
      Managed Collectors
      Interfaces
      ).
    2. Verify that the Log Collector is connected to Panorama and that the status of its disk pairs is present/available.
      >
      show log-collector serial-number
      <log-collector_SN>
      The disk pairs will display as disabled at this stage of the restoration process.
    3. Commit your changes to Panorama. Don’t commit the changes to the Collector Group just yet.
      >
      configure
      #
      commit
      #
      exit
  3. Remove the RAID disks from the old Log Collector.
    1. Power off the old Log Collector by pressing the Power button until the system shuts down.
    2. Remove the disk pairs. For details, refer to the disk replacement procedure in the M-100 or M-500 Appliance Hardware Reference Guide.
  4. Prepare the disks for migration.
    Generating the metadata for each disk pair rebuilds the indexes. Therefore, depending on the data size, this process can take a long time to complete. To expedite the process, you can launch multiple CLI sessions and run the metadata regeneration command in each session to complete the process simultaneously for every pair. For details, see Regenerate Metadata for M-Series Appliance RAID Pairs.
    1. Insert the disks into the new Log Collector. For details, refer to the disk replacement procedure in the M-100 or M-500 Appliance Hardware Reference Guide.
      The disk carriers of the M-100 appliance are incompatible with those of the M-500 appliance. Therefore, when migrating between these hardware models, you must unscrew each disk from its old carrier and insert the disk in the new carrier before inserting the disk in the new appliance.
      You must maintain the disk pair association. Although you can place a disk pair from slot A1/A2 on the old appliance into slot B1/B2 on the new appliance, you must keep the disks together in the same slot; otherwise, Panorama might not restore the data successfully.
    2. Enable the disk pairs by running the following CLI command for each pair:
      >
      request system raid add
      <slot>
      force no-format
      For example:
      >
      request system raid add A1 force no-format
      >
      request system raid add A2 force no-format
      The
      force
      and
      no-format
      arguments are required. The
      force
      argument associates the disk pair with the new Log Collector. The
      no-format
      argument prevents reformatting of the drives and retains the logs stored on the disks.
    3. Generate the metadata for each disk pair.
      >
      request metadata-regenerate slot
      <slot_number>
      For example:
      >
      request metadata-regenerate slot 1
  5. Add a Log Collector with no disks to a Collector Group.
    From this point, only commits that are required to complete the migration process on Panorama and the Log Collectors. Hold off making any other changes.
    1. Overwrite Panorama restriction to allow Log Collector with no disk to be added to a Collector Group:
      request log-migration-set-start
  6. Migrate the logs.
    You must use the Panorama CLI for this step, not the web interface.
    You must assign the new Log Collector to the Collector Group that contains the old Log Collector.
    1. Assign the new Log Collector to the Collector Group and commit your changes to Panorama.
      >
      configure
      #
      set log-collector-group
      <collector_group_name>
      logfwd-setting collectors
      <new_LC_serial_number>
      #
      commit
      #
      exit
    2. For each disk pair, migrate the logs from the old Log Collector to the new Log Collector and attach the disk pair to the new Log Collector.
      >
      request log-migration from
      <old_LC_serial_number>
      old-disk-pair
      <log_disk_pair>
      to
      <new_LC_serial_number>
      new-disk-pair
      <log_disk_pair>
      For example:
      >
      request log-migration from 003001000010 old-disk-pair A to 00300100038 new-disk-pair A
  7. Reconfigure the Collector Group.
    1. Use the web interface to assign the new Log Collector to the firewalls that forward logs (
      Panorama
      Collector Groups
      Device Log Forwarding
      ). Give the new Log Collector the same priority in the firewall preference lists as the old Log Collector.
      You cannot use the CLI change the priority assignments of firewall preference lists.
    2. Delete the old Log Collector from the Collector Group.
      >
      configure
      #
      delete log-collector-group
      <group_name>
      logfwd-setting collectors
      <old_LC_serial_number>
      For example:
      #
      delete log-collector-group DC-Collector-Group logfwd-setting collectors 003001000010
    3. Delete the old Log Collector from the Panorama configuration and commit your changes to Panorama.
      #
      delete log-collector
      <old_LC_serial_number>
      #
      commit
      #
      exit
    4. Commit the Collector Group changes so that the managed firewalls can send logs to the new Log Collector.
      >
      commit-all log-collector-config log-collector-group
      <collector_group_name>
      For example:
      >
      commit-all log-collector-config log-collector-group DC-Collector-Group
  8. Generate new keys on the new Dedicated Log Collector.
    This command is required in order to add the new Log Collector to the Collector Group and should only be run for the Collector Group of the Log Collector being replaced. This step deletes the existing RSA keys and allows Panorama to create new RSA keys.
    1. Delete all RSA keys on new Log Collector:
      request logdb update-collector-group-after-replace collector-group
      <collector-group-name>
      The process can take up to 10 minutes to completed.
  9. Confirm that SearchEngine Status is Active for all Log Collectors in the Collector Group.
    Do not continue until SearchEngine Status is Active for all Log Collectors in the Collector Group. This will result in purging of logs from the Log Collector being replaced.
    1. Show the Log Collector details by running the following commands either:
      • On Panorama for all Log Collectors:
        show log-collector all
      Alternatively, you can run the following command on each Dedicated Log Collector:
      show log-collector detail
    2. Confirm that SearchEngine Status is Active.
      Redistribution status: none
      Last commit-all: commit succeeded, current ring version 1
      SearchEngine status: Active
      md5sum 4e5055a359f7662fab8f8c4f57e24525 updated at 2017/06/14 09:58:19
  10. On the new Log Collector, replace previous Log Collector serial number with the new Log Collector serial number.
    You must replace the old Log Collector serial number with the new Log Collector serial number so that the new Log Collector will not run in to purging issues, resulting in the Log Collector being unable to purge old data from the migrated logs when necessary.
    1. Replace old Log Collector serial number with new Log Collector serial number:
      request log-migration-update-logger from
      <old-log-collector-serial-number>
      to
      <new-log-collector-serial-number>

Related Documentation