Symptoms
NDMP was restarted by the issuance of a cluster-wide MCP restart: isi_for_array pkill isi_mcp. This command is normally only issued by Support.
Isilon cluster NDMP backups are failing with the following error: NDMP Service Error: Failed to open file - Permission denied
The files that could not be backed-up were discovered to be quarantined by the AVSCAN solution.
The Isilon OneFS design for AVSCAN is constructed to backup quarantined files. When a file is quarantined, a special flag is set in metadata for the file. When operating normally, NDMP will ignore the flag and read the file for backup. If the file is restored from tape, AVSCAN will restore the file in an unquarantined state. A normal user will not be able to read the file because it is quarantined a permission denied error would be the expected response.
In the case described, NDMP was not able to read the file.
Cause
NDMP was incorrectly started.
Resolution
Reboot the node. If node reboot is not possible, please open a Service Ticket with Dell EMC Isilon Support, quoting this Article.