Framework to enable, monitor and manage comprehensive data security across the Hadoop platform.
It is common to have different workloads use the same data – some require authorizations at the table or db level ( Apache Hive queries) and others at the underlying files (Apache Spark jobs). It means, that user can access the same data in a completely different ways, and if we want to secure that data we would have to create and maintain separate Ranger policies for all services that can manipulate it (e.g. Hive and HDFS). As a result, whenever a change is made on a Hive table policy, the data admin should make a consistent change in the corresponding HDFS policy. Failure to do so could result in security and/or data exposure issues. Ideally the data admin would set a single table policy, and the corresponding file access policies would automatically be kept in sync along with access audits, referring to the table policy that enforced it. To handle these issues, Ranger Resource Mapping mechanism was implemented. Currently, it supports Hive-HDFS and Hive-Ozone resource mappings