Determine Panorama Log Storage Requirements
When you Plan Your Panorama Deployment, estimate how much log storage capacity Panorama requires to determine which Panorama Models to deploy, whether to expand the storage on those appliances beyond their default capacities, whether to deploy Dedicated Log Collectors, and whether to Configure Log Forwarding from Panorama to External Destinations. When log storage reaches the maximum capacity, Panorama automatically deletes older logs to create space for new ones.
Perform the following steps to determine the approximate log storage that Panorama requires. For details and use cases, refer to Panorama Sizing and Design Guide.
- Determine the log retention requirements of your
organization.Factors that affect log retention requirements include:
If your organization requires the removal of logs after a certain period, you can set the expiration period for each log type. You can also set a storage quota for each log type as a percentage of the total space if you need to prioritize log retention by type. For details, see Manage Storage Quotas and Expiration Periods for Logs and Reports.
- IT policy of your organization
- Log redundancy—If you enable log redundancy when you Configure a Collector Group, each log will have two copies, which doubles your required log storage capacity.
- Regulatory requirements, such as those specified by the Payment Card Industry Data Security Standard (PCI DSS), Sarbanes-Oxley Act, and Health Insurance Portability and Accountability Act (HIPAA).
- Determine the average daily logging rates.Do this multiple times each day at peak and non-peak times to estimate the average. The more often you sample the rates, the more accurate your estimate.
- Display the current log generation rate
in logs per second:
- If Panorama is not yet collecting logs, access the CLI of each firewall, run the following command, and calculate the total rates for all the firewalls. This command displays the number of logs received in the last second.
> debug log-receiver statistics
- If Panorama is already collecting logs, run the following command at the CLI of each appliance that receives logs (Panorama management server or Dedicated Log Collector) and calculate the total rates. This command gives the average logging rate for the last five minutes.
> debug log-collector log-collection-stats show incoming-logsYou can also use an SNMP manager to determine the logging rates of Log Collectors (see the panLogCollector MIB, OID 188.8.131.52.4.1.254184.108.40.206) and firewalls (see the panDeviceLogging, OID 220.127.116.11.4.1.25418.104.22.168.7).
- Calculate the average of the sampled rates.
- Calculate the daily logging rate by multiplying the average logs-per-second by 86,400.
- Display the current log generation rate in logs per second:
- Estimate the required storage capacity.This formula provides only an estimate; the exact amount of required storage will differ from the formula result.Use the formula:<required_storage_duration> x <average_log_size> x <average_logging_rate>The average log size varies considerably by log type. However, you can use 500 bytes as an approximate average log size.For example, if Panorama must store logs for 30 days and the average total logging rate for all firewalls is 21,254,400 logs per day, then the required log storage capacity is: 30 x 500 x 21,254,400 = 318,816,000,000 bytes (approximately 318GB).
- Next steps...If you determine that Panorama requires more log storage capacity:
Panorama Models Panorama is available as one of the following virtual or physical appliances, each of which supports licenses for managing up to 25, 100, ...
Collector Group Configuration
Collector Group Configuration To configure a Collector Group , click Add and complete the following fields. Collector Group Settings Configured In Description Name Panorama Collector ...
Device > Setup > Management
Device > Setup > Management Device > Setup > Management Panorama > Setup > Management On a firewall, select Device Setup Management to configure management ...
Expand Log Storage Capacity on the Panorama Virtual Appliance
Expand Log Storage Capacity on the Panorama Virtual Appliance After you Perform Initial Configuration of the Panorama Virtual Appliance , the available log storage capacity ...
Generate User/Group Activity Reports
Generate User/Group Activity Reports User/Group Activity reports summarize the web activity of individual users or user groups. Both reports include the same information except for ...
Configure a Collector Group
Configure a Collector Group Before configuring Collector Groups , decide whether each one will have a single Log Collector or multiple Log Collectors (up to ...
Increase Storage on the M-Series Appliance
Increase Storage on the M-Series Appliance After you Perform Initial Configuration of the M-Series Appliance , you can increase log storage capacity of the appliance ...
Plan Your Panorama Deployment
Plan Your Panorama Deployment Determine the management approach. Do you plan to use Panorama to centrally configure and manage the policies, to centrally administer software, ...
Monitor Panorama and Log Collector Statistics Using SNMP
Monitor Panorama and Log Collector Statistics Using SNMP You can configure an SNMP manager to request information from a Panorama management server and configure Panorama ...