Uploaded image for project: 'Teiid'
  1. Teiid
  2. TEIID-2842

Impala/ HIVE2: Unsupported compress file

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Do
    • Major
    • 8.7
    • 8.6
    • Query Engine
    • Hide

      Setup Impala database with compress file.

      Connect to Impala (HIVE2) from teiid.

      Exception from Teiid:

      java.sql.SQLException: AnalysisException: Failed to load metadata for table: default.omniturelogs
CAUSED BY: TableLoadingException: Failed to load metadata for table: 
omniturelogs
CAUSED BY: RuntimeException: Compressed text files are not supported: hdfs://localhost.localdomain:8020/user/cloudera/omniturelogs/Omniture.0.tsv.gz
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:161)
at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:149)
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:182)
at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:246)
at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
at org.teiid.translator.hive.HiveMetadataProcessor.addTable(HiveMetadataProcessor.java:112)
at org.teiid.translator.hive.HiveMetadataProcessor.getConnectorMetadata(HiveMetadataProcessor.java:48)
at org.teiid.translator.jdbc.JDBCExecutionFactory.getMetadata(JDBCExecutionFactory.java:311)
	... 155 more
      Show
      Setup Impala database with compress file. Connect to Impala (HIVE2) from teiid. Exception from Teiid: java.sql.SQLException: AnalysisException: Failed to load metadata for table: default .omniturelogs CAUSED BY: TableLoadingException: Failed to load metadata for table: omniturelogs CAUSED BY: RuntimeException: Compressed text files are not supported: hdfs: //localhost.localdomain:8020/user/cloudera/omniturelogs/Omniture.0.tsv.gz at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:161) at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:149) at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:182) at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:246) at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208) at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208) at org.teiid.translator.hive.HiveMetadataProcessor.addTable(HiveMetadataProcessor.java:112) at org.teiid.translator.hive.HiveMetadataProcessor.getConnectorMetadata(HiveMetadataProcessor.java:48) at org.teiid.translator.jdbc.JDBCExecutionFactory.getMetadata(JDBCExecutionFactory.java:311) ... 155 more

    Description

      Teiid makes a query call "Describe table" in HiveMetadataProcessor.addTable(....). However, if the table contains compress file, HIVE2 driver would return the following execption:

      java.sql.SQLException: AnalysisException: Failed to load metadata for table: default.omniturelogs

CAUSED BY: TableLoadingException: Failed to load metadata for table: 
omniturelogs
CAUSED BY: RuntimeException: Compressed text files are not supported: hdfs://localhost.localdomain:8020/user/cloudera/omniturelogs/Omniture.0.tsv.gz
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:161)
at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:149)
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:182)
at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:246)	
at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)	
at org.teiid.translator.hive.HiveMetadataProcessor.addTable(HiveMetadataProcessor.java:112)	
at org.teiid.translator.hive.HiveMetadataProcessor.getConnectorMetadata(HiveMetadataProcessor.java:48)
	
at org.teiid.translator.jdbc.JDBCExecutionFactory.getMetadata(JDBCExecutionFactory.java:311)
	... 155 more

      Maybe Teiid should call "DESCRIBE FORMATTED table" for table that contains compress file.

      Reference:

      http://grokbase.com/t/cloudera/impala-user/13b7c9apmx/impala-failed-to-query-snappy-compression-data

      Attachments

        Activity

          People

            rhn-engineering-rareddy Ramesh Reddy
            mchantibco Ivan Chan (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: