Uploaded image for project: 'Teiid'
  1. Teiid
  2. TEIID-4622

Adding new data quality functions from osDQ

    Details

    • Type: Feature Request
    • Status: Resolved (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: Open To Community
    • Fix Version/s: 9.2
    • Component/s: Common
    • Labels:
      None
    • Environment:

      Description

      Following functions have been added into osdq-core for integration with teiid.

      String functions :

      // Encrypting a string using key and AES encryption
      String encrypt ( String val, String key)
      String decrypt ( String val, String key)

      // Fuzzy distance - similarity between two strings
      float levestheindistance ( String a, String b)
      float jarowinklerdistance( String a , String b)
      float cosinedistance (String a, String b)

      // Format check for PII ( personal information)
      boolean isCreditCardFormat(String a)
      boolean isSSNFormat(String a)
      boolean isPhoneFormat(String a)
      boolean isEmailFormat(String a)
      boolean hasWhiteSpace(String a )

      Date Functions

      // converting date into universal recognized format
      long dateToEpoch(java.util.Date date)
      Date epochToDate(long epoch)
      Date epochToDate(long epoch, String TimeZone)
      long diffInSec(date a, date b)
      String convertToFormat ( Date a, String Format)

      Numerical Functions

      // Statistical functions
      double stdDev(Number[] numSeries)
      double range(Number[] numSeries)
      double median(Number[] numSeries)

        Gliffy Diagrams

          Attachments

          1. DateUtil.java
            2 kB
            vivek singh
          2. NumberUtil.java
            1 kB
            vivek singh
          3. StringUtil.java
            4 kB
            vivek singh

            Issue Links

              Activity

                People

                • Assignee:
                  kylin Kylin Soong
                  Reporter:
                  osdq vivek singh
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  4 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved: