Version 3.8.1

RELEASE DATE: Jul, 2023

Improvements

JD-6443 Improve TRACE message to monitor cubes scenarios
JD-6444 Cubes Generation Optimization
JD-6448 Tableau connector integration - minor compliance fix

Bug Fixes

JD-6010 Composed string function reach size limitations
JD-6092 Server fail to handle corrupted compressed map
JD-6442 Connector load failed due to log4j issue
JD-6447 Server resource manager non-optimal calculation may cause query rejection

Version 3.8.0

RELEASE DATE: Jun, 2022

New Features

JD-6426 Implement SHOW PRIMARY KEY and PK ODBC API
JD-6423 SPLIT function

Improvements

JD-6439 Loader - allow remove profile file and and add schema name to report file name. Set via parameters
JD-6434 Connector: use latest log4j (2.17.0) - mitigation for log4j vulnerability CVE-2021-44228
JD-6419 Handle pass through ODBC syntax at server level via host substitute fie (Tableau 2020.3)

Bug Fixes

JD-6440 Fix scheduled load lock corruption. The scheduled load service stop when encountering lock corruption and some scheduled jobs were not executed
JD-6433 Fix cube generation issue for queries with escaped single quote $'$ inside string literal that failed due to show cubes syntax error. Query sent to show cubes has non-escaped single quote
JD-6432 Fix inconsistent results: when join query has non-standard case expression that return 0 or 1 instead of true/false
JD-6427 Fix wrong result: day function over trunk function return wrong value
JD-6425 Fix case were count distinct query internally fails but keeps running in a loop filling logs with error message
JD-6422 Minor fix for JethroAdmin collect logs - correct handling of symbolic links in log folders
JD-6421 Fix nested Case When with internal Boolean expression that return numeric value (0 or 1) fails with "Double conversion for result of Case-When clause was requested"
JD-6420 Fix wrong results: group by show -1 values in more than one group following issue with fix JD-6386 in version 3.6.1
JD-6418 Fix server core - case with string range condition

Version 3.7.0

- Cubes cleanup by usage important improvements
- Support Tableau 2020.3
- Important bug fixes

RELEASE DATE: May, 2021

New Features

JD-6409 Support Having expression with non-aggregate group by expression (Tableau 2020.3)
JD-6410 Support function over group by expression in target list. Currently fails with: "Expression not in GROUP BY key" (Tableau 2020.3)

Improvements

JD-6398 Cubes cleanup by usage to drop unused rebuild cubes - cubes rebuild/update to keep cubes creation date
JD-6404 Notify in log on rows duplication in join
JD-6414 Support centos/rhel 8 - handle libgcrupt.so.11
JD-6416 Support Boolean expression that return numeric value (1 or 0) instead of true/false (Tableau 2020.3)

Bug Fixes

JD-6391 Server terminated when deleting from local cache
JD-6392 Server core - left join and complex if expression in where referencing to right table (outer to inner join optimization issue)
JD-6394 Bad decimal values fetch from Parquet via connector for high precision decimal column (38,10)
JD-6395 Repeated input stream error messages in log due to invalid adaptive entries causing server memory to inflate until server is killed
JD-6399 Cubes/adaptive usage info may be incomplete/inaccurate in some cases (new usage info is ignored)
JD-6400 Flatten query cause segmentation fault
JD-6401 Wrong value loaded to table when input data contains very long text (>4096) + 4096 max string size no imposed when using default (simple) tokenizer
JD-6402 Wrong results: join is wrongly removed by optimizer
JD-6408 Query with IN expression inside GB function fails with "expression is not in GROUP BY" error (Tableau 2020.3)
JD-6412 Join of sub-query with join key being literal fails with request execution failed (Join column wasn't found in left table) (Tableau 2020.3)
JD-6415 Group by on curdate() fails (Tableau 2020.3)
JD-6417 Aggregation query with having count(1)>1 and cross join returns large results set - should return single line (Tableau 2020.3)

Version 3.6.1

RELEASE DATE: Aug, 2020

Improvements

JD-6379 Jethro folders and files permissions tightening
JD-6381 Add GPG key to rpm
JD-6383 Support query text substitute (beta)
JD-6385 Cube maintenance: monitor adaptive entries usage and auto drop unused cubes and cache entries

Bug Fixes

JD-6351 Reset keys initial hash default
JD-6371 Server failure caused by query with cross join
JD-6372 Multiple "cancel event initiated" and "reached limit event" in log. Issue with query cancellation
JD-6373 Possible wrong result when flatten optimization applied on left join and right table is a sub-query with join (following 3.6 JD-6355)
JD-6374 Server failure on show cube query following duplicate alias error when query contains special characters
JD-6375 Concurrent loads fail due to lock issue - exception raised while trying to unlock lock
JD-6378 Parquet file read failed with: libsnappyjava.so: failed to map segment from shared object
JD-6386 Duplicated rows fetched on select * from join in a specific scenario
JD-6388 Possible wrong results when flatten optimization applied on join of multi table sub-query (following 3.6 JD-6355)
JD-6389 Query fails when filter comparing timestamp to date before 1/1/1970

Version 3.6.0

RELEASE DATE: Feb, 2020

New Features

JD-6282 Implement Full Outer Join

Improvements

JD-6341 Support Coalesce function
JD-6348 Reduce query init time - cache large schemas in deserialized format
JD-6352 Support Implicit Cross Join
JD-6355 Flatten query with join in sub query and outer query
JD-6357 Add queries statistics log message for simple queries stats analysis
JD-6363 Show local cache - add log to monitor progress

Bug Fixes

JD-6283 IfNull function fails if both columns are NULL
JD-6316 Query using Cubes fails with: ("internal error: exception raised" - "could not find the virtual object of the virtual column")
JD-6337 Timestamps functions error on NULL
JD-6338 Missing implicit group by null on aggregation with having
JD-6339 Hadoop URI issues
JD-6344 Query fails: aggregation refers to joined sub-query aggregation
JD-6345 Incomplete TRUE/FALSE literals handling in some expressions
JD-6350 Fail to write to adaptive for query with sub-query/view ("Can not write adaptive, 2 or more different expressions are equal")
JD-6351 Memory/files footprint of server is high when schema contain large number of low cardinality string columns

Version 3.5.1

RELEASE DATE: Oct, 2019

Improvements

JD-6320 New function: current_user()
JD-6334 Show external data source columns to return Jethro types (required from JM)
JD-6322 NUMERICCOUNT function
JD-6323 SHOW TABLE COLUMNS - skip calculation of very high cardinality distinct when metadata not available
JD-6324 show statistics: add show data sources and show external tables
JD-6325 Improve status checks for IO operations

Bug Fixes

JD-6292 Server failure following INSERT INTO VALUES with NULL::STRING literal
JD-6301 Server failure at cubes match
JD-6319 Query joining managed table with external table fails
JD-6326 Reduce maint service IO operation during garbage collection and cubes scan cycles
JD-6327 Cube gets where condition following cube update due to rewrite that pushes ON condition into WHERE clause but does not remove it from ON condition
JD-6329 Connector: inconsistent results from Parquet decimal data type
JD-6330 Accuracy issue: query with left join where right table is a sub-query with filter
JD-6336 Connector: fail to read Parquet binary columns as strings

Version 3.5.0

RELEASE DATE: Feb, 2019

- Merge tables
- Various improvements
- Bug fixes

Upgrade Instructions

Not special upgrade instruction from 3.4.x are required.

Compatibility

Compatible components versions:

JethroManager 1.6
Ambari Management Package 1.09

New Features

JD-6278 MERGE TABLE - quick vertical merge of two or more tables into a new table

Improvements

JD-6247 Support preview for orc and parquet files
JD-6286 Allow LDAP SSL without certificate
JD-6288 Concurrent query init time optimization: cache schema and global config, reduce keys refresh frequency
JD-6290 Add support from HDP3 client environment
JD-6303 SHOW FULL TABLES - support wildcard semantics instead of table name (=all tables)
JD-6305 Partial support ORACLE as generic JDBC data source
JD-6306 Parameters default values changes

Bug Fixes

JD-6313 Inconsistent results when querying union joined as right table with empty results set on union sub-select
JD-6279 Select DATE data type from Parquet/ORC fails or fetch wrong values
JD-6285 Altering value of query.timeout is ignored
JD-6289 Total query time in plan for very fast queries shows wrong value (1537328463.426310)
JD-6291 Server core following query failure - cast of timestamp column to string in where clause
JD-6294 Accuracy issue - query with where expressions with case pushed down to sub-query
JD-6300 Query queueing issues
JD-6307 Accuracy issue - case and cross join
JD-6308 Keys dat files corrupted / missing while metadata indicated keys file is complete. Server core when reading keys file
JD-6309 Accuracy issue following partition overwrite when value in replaced partition not longer exists in the table
JD-6310 External table filter rewrite issues

Version 3.4.8

RELEASE DATE: Jul 8, 2018

- Functionality required for Hive 3 integration
- Bug fixes

Upgrade Instructions

IMPORTANT!!

Read carefully the version specific upgrade notes which are relevant for your upgrade process, and perform all the steps which are required to be made, before and after starting the upgrade process.

Compatibility

Compatible components versions:

JethroManager 1.6
Ambari Management Package 1.09

Improvements

JD-5359 Allow using OFFSET even if ORDER BY not specified
JD-5467 SHOW FUNCTIONS - new show command
JD-6070 Enable preemptive timeout cancellation by default

Bug Fixes

JD-5734 The false expression "<> NULL" in WHERE clause cause server failure
JD-6096 Loader fails with core dump on exit
JD-6124 Various SHOW CREATE TABLE issues with external table attributes
JD-6169 Query accuracy - when if function branch is Qlik function and if function term is negative (1=0)
JD-6200 Server failure can occur when query is being canceled while query in pending in queue
JD-6203 Maint log error - fail to delete OBSOLETE cube dat file. This is valid scenario - error should not be logged
JD-6248 Cast from INTEGER to Integer failed error received when fetching from external table
JD-6249 Monitor will not restarted in case of immediate call to service start of service stop command
JD-6264 Unable to connect to LDAP Posix groups in Oracle Directory Server
JD-6265 Connector fails with "Too many open files" when reading from Parquet/ORC
JD-6270 Fix log printout of SQL statement with LIKE function
JD-6271 CountDistinct container memory leak during cube read

Minor Bug Fixes

JD-6220 spelling and style fixes to ldap log messages

Version 3.4.7

RELEASE DATE: Jun 6, 2018

- Support impersonation for external tables access
- Fix loader performance degradation
- Bug fixes

Upgrade Instructions

IMPORTANT!!

Compatibility

Compatible components versions:

JethroManager 1.6
Ambari Management Package 1.09

New Features

JD-4834 Support impersonation - delegate credentials when accessing external tables
JD-5793 Support metadata and preview from external data sources (for internal use by JM)

Improvements

JD-6180 change MapR version tagging to postfix instead of prefix

Bug Fixes

JD-5940 JethroMonitor log owner set group as user
JD-6136 Enable preemptive timeout cancellation by default
JD-6150 Load performance degradation
JD-6155 BASH complete incompatible with KSH
JD-6159 Collect logs does not output SHOW TABLE MAINT for all tables
JD-6162 Hadoop home setting for mapr is incorrect
JD-6177 Query with count distinct over cube generate internal error
JD-6213 Jethro Server failure following cube check (show cubes) syntax error

Version 3.4.6

RELEASE DATE: May 16, 2018

- DDL commands for show and alter external tables
- Index rebuild
- New string functions (lcase/ucase)
- Bug fixes

Upgrade Instructions

IMPORTANT!!

Compatibility

Compatible components versions:

JethroManager 1.6
Ambari Management Package 1.09

New Features

JD-4709 SHOW CREATE TABLE
JD-5779 ALTER EXTERNAL TABLE
JD-5931 Add SQL functions: LCASE() and UCASE()
JD-6021 ALTER INDEX REBUILD

Improvements

JD-5206 Query plan improvements
JD-5219 SHOW PARAMS EXTENDED with parameters metadata
JD-5834 Expand SHOW EXTERNAL TABLES] to show all attributes
JD-5844 SHOW EXTERNAL TABLE COLUMNS table-name]
JD-5865 Support preemptive query cancellation on timeout
JD-5954 New log for GC file deletion

Bug Fixes

JD-5298 Thread sys limit file /etc/security/limits.d/jethrodata got corrupted
JD-5403 show tables in schema ignores wrong command syntax
JD-5893 LDAP authentication fails with Ds that contain special characters
JD-5898 Frequent schema changes cause issue with cube gen and match due to wrong handling of different schema versions on cube match
JD-6037 Create External Data Source and Tables requests hang
JD-6044 Server failure on query executing when push join write disabled by configuration
JD-6045 Empty key dat file is created when loader fails on close
JD-6053 GROUP BY STATISTICS shows garbage rows count for cube candidates exceeded max size in bytes
JD-6095 LDAP group name attribute parameter is ignored on group search. User id attribute is used instead
JD-6096 Load may fail ungracefully (core) during exit
JD-6108 Maint stops sending cubes for check / generate after a cube check run fails
JD-6109 Flatten rewrite generates wrong expression in case of JOIN in outer SQL
JD-6112 Server failure on join query with where expression schema not specified and not default
JD-6117 In the case "cube candidate exceeded max size in bytes", should not write any tooBig statistics

Minor Bug Fixes

JD-5373 "schema <>" is presented on "show join indexes" on non def_schema
JD-5404 Unclear error message when table name is missing on drop scheduled loads command
JD-5720 Failed to commit version dat file for adaptive error should by INFO level message

Version 3.4.5

RELEASE DATE: Apr 17, 2018

- Optimizations for queries with large dim tables
- Support partitions when reading from Parquet/ORC
- IO optimizations
- Bug fixes

Upgrade Instructions

IMPORTANT!!

Compatibility

Compatible components versions:

JethroManager 1.5.1
Ambari Management Package 1.09

Improvements

JD-5977 Ext_table: Support partitions when reading from Parquet/ORC
JD-6019 Star no-where / join removal: add configuration for unique dim value threshold and set default to 100M
JD-6032 Optimize IO during Fetch Dispatcher initialization

Bug Fixes

JD-5851 Query failed with "Reached limit" error message
JD-5882 Instance name verification is not imposed in multi part identifier in FROM clause

Version 3.4.4

RELEASE DATE: Apr 3, 2018

- Optimizations for queries with joins of flat projections (PBI)
- Optimizations for query init stages
- Monitor slow IO operations in log
- Support column rename
- Important bug fixes

Upgrade Instructions

IMPORTANT!!

Compatibility

Compatible components versions:

JethroManager 1.5.1
Ambari Management Package 1.09

New Features

JD-2857 Optimization: Trim unused columns at rewrite stage
JD-3062 Support ALTER TABLE RENAME COLUMN
JD-5773 Optimization: Support flatten query over joins including joins with subqueries

Improvements

JD-5449 Improve error message in case process fork fails
JD-5067 Collect grouping sizes statistics to be used for cubes generation. Show statistics via: SHOW GROUP BY STATISTICS
JD-5701 Change default for parameter query.in.filter.threshold from 1000 to 2500
JD-5780 Do not add distinct for sub-select in IN clause if all values are unique
JD-5795 Optimize query initialization stage (optimize toSQL function)
JD-5867 Show WARNING in log in simple IO operations (listDir, open) takes too much time

Bug Fixes

JD-4079 ToSQL: Missing alias in after-rewrite query
JD-5575 Cubes not match by original query with specific SUM(case... ) expression causing continues cube generation tries
JD-5722 Cancel of query with UNION takes a very long time to complete
JD-5737 Server failure following UPDATE CUBE request on specific cube scenario
JD-5742 Cancel Query fails due to "CSN node build fail"
JD-5760 Potential wrong cube generation/match following JD-5544 fix (3.4.1)
JD-5830 External table: accuracy issue when running query joining and filtering multiple external tables
JD-5866 Can't grant roll to a group which its name includes hyphen
JD-5874 Adaptive index write in not async and may slow query execution
JD-5900 Cubes generation may hang when storage schema is newer then generate session schema
JD-5904 Accuracy issue in cube scenario for count distinct queries following partition drop
JD-5921 Unspecific error code/message is logged after HDFS error
JD-5938 Potential server failure in case of PLANNER log verbosity is DEBUG
JD-5962 Server consumes significant more memory than necessary upon INSERT INTO/SELECT * from large external table
JD-5990 Support additional Null Safe Join syntax (PowerBI)

Minor Bug Fixes

JD-5564 Log message spelling fix

Version 3.4.3

RELEASE DATE: Feb 6, 2018

- Files connector now support Parquet and ORC formats
- Cancel query improvements
- Important bug fixes

Upgrade Instructions

IMPORTANT!!

Compatibility

Compatible components versions:

JethroManager 1.5.1
Ambari Management Package 1.09

New Features

JD-5631 SHOW TABLES] STATS - fast show of table metadata
JD-5730 External table files connector - Support Parquet and ORC files formats
JD-5811 Support new function: Left(string, int

Improvements

JD-5247 Expression in SELECT list may be function of GROUP BY expressions
JD-5735 Optimizer: expend transformation scenarios of OUTER JOINS to INNER JOINS
JD-5756 Optimizer: Allow Push-Join optimization for OUTER LEFT JOIN
JD-5759 Ext TBL: Allow conversion of DECIMAL type from external data source to Jethro numeric data type
JD-5783 Control column names case in result set via config

Bug Fixes

JD-5693 SELECT DISTINCT query fail with 'Request execution failed'
JD-5732 Cancel query: cross join query doesn't responed immediatly to cancellation
JD-5786 Cancel Query: query on external table doesn't responed immediatly to cancellation
JD-5797 SQL statistics should use SHOW TABLES MAINT instead of SHOW ALL TABLES MAINT

Version 3.4.2

RELEASE DATE: Feb 12, 2018

- Auto renewal/recreation of Kerberos ticket
- Jethro Monitor Service replacing crontab job
- Connector to any external data source via generic JDBC connector
- Cancel query improvements
- Important bug fixes

Upgrade Instructions

IMPORTANT!!

Compatibility

Compatible components versions:

JethroManager 1.5.1
Ambari Management Package 1.09

New Features

JD-5385 Auto renewal/recreation of Kerberos ticket by Jethro
JD-5602 Jethro Monitor Service (replace crontab job)
JD-5638 CREATE EXTERNAL DATA SOURCE to support generic JDBC connector

Improvements

JD-2881 Apply star transformation to join keys of different data types
JD-5606 Backup jd-hadoop-env.sh on version upgrade
JD-5458 Cube match rewrite optimization: remove outer group by when it is redindant to improve query over cube performance
JD-5490 Support partition pruning for string columns
JD-5628 Expand SHOW EXTERNAL DATA SOURCE[S] to show all attributes
JD-5670 Cancel Query flow refactoring in Node execution (internal)
JD-5703 Support SHOW TABLE EXTENDED for specific table

Bug Fixes

JD-5086 EXT_table: query over external table with WHERE and OR on join tables fails
JD-5261 Query fail to find cube the was generated from that query following cube rewrite
JD-5316 Cube with where does not survive rebuild
JD-5334 Cubes .dat files are reported missing in server log when trying to match
JD-5456 Unoptimized multi allocation during client request
JD-5573 GB function rewrite on query with self-join returns internal error
JD-5580 Query with QLIK function fails with internal error ("could not find the virtual object of the virtual column")
JD-5591 Query with function over timestamp columns that appears more then once in the target list fails on cube reading with internal error ("could not find the virtual object of the virtual column")
JD-5596 Generic low level error messages appears as FATAL in log - should be WARN level
JD-5597 Query fail with "FingerPrint mismatch" error
JD-5626 Join indexes fix utility does not support multi schema
JD-5632 JethroClient core when running query that is killed by another client
JD-5640 Statistics are not collected if jethro password is changed
JD-5654 Cancel Query takes a very long time to complete for query with multiple joins
JD-5674 Queries on external table hang due to mishandling of exception from external data source
JD-5678 Memory Leak in query with count distinct over very high cardinality DOUBLE column
JD-5679 Query hangs when sub-query in where fails
JD-5695 Query hangs when partitioning dim by string columns and the filter (NOT IN) is on this column

Minor Bug Fixes

JD-5535 Self join query without table aliases failed on unclear error message (Request execution failed)
JD-5570 service jethro restart generate "Attempting to gracefully stop Instance" message to the screen

Version 3.4.1

RELEASE DATE: Jan 22, 2018

- Support table move between schemas
- Cubes usage visibility improvements
- Cache query results over cubes
- Important bug fixes

Upgrade Instructions

IMPORTANT!!

Compatibility

See 3.4.0 release notes

Improvements

JD-4451 Explicitly show cubes usage in query plan
JD-5014 Show cubes - add creation time and update time
JD-5457 Create results cache entries for queries over cubes for slow queries
JD-5510 ALTER TABLE RENAME support move between schemas

Bug Fixes

JD-4968 Cubes rebuild is not preserving the cube original tag
JD-5394 Cubes generation stop sending requests following failure in cube check request
JD-5459 Cubes generation stop sending requests following failure to send requests to server
JD-5460 Load from external table mapped to file failed is number of columns GT 512
JD-5477 Query fails on internal error ("could not find the virtual object of the virtual column") due to wrong handle of literal expression
JD-5487 Accuracy - where expression with function on string that contain IS NULL ignores null values in column (function to index optimization issue)
JD-5491 Potential wrong results when filter include CASE and condition expressions in CASE contain AND operator
JD-5513 Select from external table reject numeric values of the format "+12345" (fail to convert value to INT/BIGINT)
JD-5544 CAST on literal within SUM aggregation cause cube not to be matched
JD-5547 Cubes generation stop sending requests following rebuild error caused by race condition
JD-5545 Too big assertion when cube generation reach cube size limit is not working since version 3.3.2
JD-5546 JethroServer failure when NULL from subquery passed as target column of IN
JD-5552 Fix for upgrade tool from pre-3.4.0 releases: correct handling of uppercase passwords and increase wait time for server to start

Version 3.4.0

RELEASE DATE: Dec 25, 2017

- Support multiple schemas.
- Fix environment settings for JAVA to simplfy initial setup
- Bug fixes

Upgrade Instructions

IMPORTANT!!

Before upgrade:

Stop all loads and stop JethroLoadsScheduler service (service jethro stop [instance-name] loadscheduler)
Confirm the load scheduler event drop folder is empty (ls [storage-root-path]/[instance-name]/loads/drop)
Backup schema files to allow easy downgrade if needed (data model is changed by the new version, therefore schema files will be edited).
For HDFS instance:
```
hadoop fs –copyToLocal {instance-location}/metadata/schema* /backup_schema_340/
```
For local instance:
```
cp {instance-location}/metadata/schema* /backup_schema_340/
```
Instance-location can be found in local-conf.ini file as the value of storage.root.path variable.

After upgrade to 3.4 it is mandatory to run upgrade tool over each existing instance.
Usage:

upgradeTo3.4_MultiSchema <instance> <ip/localhost>:<port> -u <user> -p <pass>

This tool creates system schema "sys" and move jethro system tables to "sys" schema

Compatibility

Server version 3.4 is NOT compatible with previous version of ODBC, JDBC and JethroManager. All client components must be upgraded.

Compatible client versions:

ODBC 3.7
JDBC 3.6
JethroManager 1.5

New Features

JD-1137 Multiple Schames support
JD-4653 Schema related DDL commands: CREATE SCHEMA, DROP SCHEMA, SHOW SCHEMA, USE

Improvements

JD-5197 CREATE EXTERNAL TABLE to allow setting file format spec (delimiter)
JD-5234 Fix jethro CLASSPATH issues
JD-5267 JethroClient: Allow multiple statements when passing request as argument
JD-4569 Improve environment settings for JAVA to support out of the box range of Hadoop distribution and Hive configurations

Bug Fixes

JD-3653 Query fails due to corrupted cube read with "Error getting unit no by serial no". Occurs when cubes group by uses 128bit CSH Hash
JD-4945 Server failure due to invalid casting of null in INSERT INTO
JD-5019 Query with complex timestamp expression fail with error (cast issue)
JD-5131 Cubes queues status message may show identical status line more then once
JD-5138 Rebuild cubes may not be re-generated following intensive schema changes
JD-5139 Rename of system table is not fully blocked
JD-5235 Cubes are ignored and not recreated following internal exception ("Error getting unit no by serial no")
JD-5239 CREATE EXTERNAL DATA SOURCE doesn't trim with extra space after name appends space to the name
JD-5252 Server failure when INSERT INTO value contains invalid byte sequence ('\0')
JD-5284 INSERT INTO: exception in connector CSV parser due to line > 4K silently causes incomplete load
JD-5286 INSERT INTO: loader incorrectly casts special floating point values: nan, infinite
JD-5351 Server failure following intesive autentication try when calling openldap method
JD-5398 Cube update will fail following rename of table and cube will not be updated
JD-5415 SHOW FULL TABLES is missing in collect statistics
JD-5446 Maint push "Starting Garbage Collector Cycle" message every second

Minor Bug Fixes

JD-5186 Fix message typo for: referenital integrity optimization
JD-5340 Schedule loads log contains repated occurences of the messages "The version was null, therefore will not read the file"

Version 3.3.2

RELEASE DATE: Dec 7, 2017

- Queries load balancing: skip busy nodes that are queueing queries. Require upgrade of ODBC/JDBC to version 3.5
- Generate and match cubes for count distinct queries without group by
- Allow long identifier names (128 characters)
- Cube generation efficency: persistent too-big statistics
- Important bug fixes

Upgrade Instructions

Before upgrade:

- Stop all loads and stop JethroLoadsScheduler service (service jethro stop [instance-name] loadscheduler)

- Confirm the load scheduler event drop folder is empty (ls [storage-root-path]/instance-name]/loads/drop)

New Features

JD-4827 Queries load balancing - skip busy nodes

Improvements

JD-3118 Dynamic aggregation: Count distinct aggregation without group by to match/gen cubes
JD-3995 Persistency for cube Too-Big statistics
JD-4675 Optimizer: aggregation queries are rewritten as Group By NULL to support CND cubes match and improve performance
JD-4794 Include insert into SQL details in loader event system table
JD-4978 Allow identifiers length of up to 128 characters
JD-5152 Minor: improve message on too big cube

Bug Fixes

JD-4728 Orphan loader files of dropped tables are not cleaned by garbage collector
JD-4812 DROP PARTITION requires range values to be between HIGH to LOW
JD-4868 When LDAP Query result contains more than 1000 entries, it doesn't return the results
JD-4887 Plan presents meaningless time for 'EXTERNAL TABLE FETCH' time
JD-4925 Insert into fails if data contains the special charcter '/001'
JD-5044 Scheduled Load rule for jethro$_loader_events is not properly created on instance creation
JD-5055 Manual cube generation fails when multiple cube generations servers are configured
JD-5111 "Illegal construction of TupleSet. Size = 0" on limit 0 query
JD-5161 Non-helpful error return when insert into fails due to invalid data ("trying to flush footer report section more than once")
JD-5170 JethroMaint garbage collector erasing dat files of valid cubes
JD-5171 JethroServer failure upon retry of a query following cube/adaptive entry not found
JD-5175 When log text is longer then 1024 chars, the Loader is killed
JD-5192 SHOW CUBES operation is very slow
JD-5215 INSERT INTO from an external data source may generate defect records in destination Jethro table
JD-5216 Authorization is checked more then once during parsing - may effect query init time
JD-5238 Temporary files are not removed from tmp folder - GC to remove old tmp files periodicly
JD-5279 JethroClient misinterpt "\N" literal in a line. User unable to define "\N" as NULL in new external table
JD-5322 Server crash when calling open ldap method

Minor Bug Fixes

JD-5260 Improve error message in lo

Version 3.3.1

RELEASE DATE: Nov 18, 2017

- Important improvments and bug Fixes

Improvements

JD-5124 Limit max cube/adaptive entry size in byte via config
JD-5125 Optimize limit 0 and where 0=1 queries (commonly used by Tableau and other BI tools)

Bug Fixes

JD-5118 Table OVERWRITE or TRUNCATE choose lose of granted table permissions
JD-5119 Schema inflate following intensive schema changes and/or table OVERWRITE operations. This can lead to system wide performance issues.
JD-5147 Loader - wrong logic of rejecting files as having unsupported format (zip) based on filename or path
JD-5148 JethorClient -c create CSV file with wrong timestamp values (following 3.3.0 timestamp range expansion)

Version 3.3.0

RELEASE DATE: Nov 5, 2017

- Extended dates range for TIMESTAMP data type: 01/01/1400 - 31/12/9999
- Bug Fixes

Compatibility

Server version 3.3 is NOT compatible with previous version of ODBC, JDBC and JethroManager. All client components must be upgraded.

Compatible client versions:

ODBC 3.3
JDBC 3.3
JethroManager 1.3.1

New Features

JD-4703 TIMESTAMP data type now support extended dates range (from 01/01/1400 to 31/12/9999)
JD-4545 Refactor optimizer rewrites - various performance optimizations and improve optimizer flow and logging

Improvements

JD-4924 File connector to support UTF-8 encoding
JD-4956 Collect log to collect schedule loads metadata

Bug Fixes

JD-3598 Adding a new Timestamp column to an existing table fails
JD-4501 CREATE TABLE may takes long time to complete
JD-4714 Column name is partially presented
JD-4856 Accuracy issue when cube is used for COUNT DISTINCT over case function when puki optimization is enabled
JD-4870 Schedule Load- "lsof" is called when drop folder is hdfs
JD-4884 Assume referential integrity rewrite doesn't eliminate sequence of unnecessary JOIN expressions on certain scenarios with QLIK function
JD-4902 Accuracy issue when assume referential integrity is enabled and QLIK function is used
JD-4909 JethroAdmin create-instance error msg fixes
JD-4912 Query with duplicate line of COUNT(DISTINCT (CASE WHEN )) is failing with "Request execution failed"
JD-4914 Scheduled load: incorrect recursive handling of files in subfolders under the drop folder when stating specific file pattern
JD-4926 Cubes are not generated and check test failed when cubes are disabled (dynamic.aggregation.enable=0)
JD-4928 Possible accuracy issue with partitions on timestamp if maximum value of partition has fractional seconds
JD-4946 Jethro Scheduled Load - De-Serialization error due to corrupted loadstate*.xml file
JD-4955 Jethro Schedule Loads service should start by default only on one node in the cluster (loader node)
JD-4964 schedule loads fail with log message 'Exception in Thread 'some name': basic_string::erase'
JD-4965 LIMIT and WHERE clauses are ignored for external tables over files data source
JD-4985 After ping failure monitor may start server too quickly after stop causing server start to fail
JD-4996 Cubes auto generation/update requests are not sent due to rare race condition
JD-4998 Accuracy issue with WHERE year(TS) NOT IN (...). NOT operator not applied
JD-5026 Unable to connect to HIVE External Data Source in kerberized environment due to missing path in classpath
JD-5066 External table from HDFS stack forever when no file is in the hdfs path

Minor Bug Fixes

JD-4987 Change "loaded" to "inserted" in INSERT INTO success message

Version 3.2.0

RELEASE DATE: Oct 4, 2017

Major improvements in cubes generation and maintenances:
- Cubes generation and maintenance can now be scaled to more than one server
- Cubes generation and maintenance reorganized and redundant entries removed
- Cubes status tracing logs significantly improved
- New DDL: SHOW CUBES FROM .. can be used to show existing and potentials cubes for query

Improvements

JD-3575 Cubes generation and maintenance scalability - support multi servers cube gen/maint
JD-3931 Reorganize cubes generation and maintenance queues
JD-3969 Null safe join to support functions in ON expression
JD-4121 Dynamically disable/enable cubes scan and generation background cycle via configuration
JD-4330 Push to cube generation and maintenance queues only if a potential cubes can be created and support new DDL: SHOW CUBES FROM
JD-4791 Improvements for log messages reporting cube generation
JD-4843 Main stability - do not exit maint after failures - additional scenarios not covered in 3.0.5

Bug Fixes

JD-4061 Duplicate and redundant entries are pushed to cube generation/update/regen queue causing queue to inflate
JD-4805 Query does not refer to suitable cube which was generated with RIGHT OUTER JOIN
JD-4832 A redented adaptive entry is created for query that finds a cube match
JD-4836 Jethro uninstall should delete $JETHRO_HOME even if it is not empty
JD-4901 Possible lock corruption due to wrong order of locks for schema-lock
JD-4905 Query with CASE fails with "Request execution failed" due to type-mismatch

Version 3.1.1

RELEASE DATE: Sep 28, 2017

Bug Fixes

JD-4861 Query fails with "ADAPTIVE ERROR FingerPrint mismatch"
JD-4899 Order By ignored if asc and desc order both specified after push join rewrite
JD-4910 File connector fails on hdfs files hadoop-hdfs jar missing in classpath
JD-4917 File connector fails on hdfs files with ArrayIndexOutOfBoundsException error
JD-4919 Create view is failing if now() function exist in the select statement
JD-4920 Flatten query optimization skips left sub-query in join

Version 3.1.0

RELEASE DATE: Sep 19, 2017

- Support external connector for files
- Various connectors related improvements and fixes
- Additional bug fixes

New Features

JD-4572 External connector for files: allow creating an external table over HDFS/Posix files

Improvements

JD-4553 Connectors - manage/expose version
JD-4871 INSERT INTO should to return message with the number of rows inserted

Bug Fixes

JD-4269 ExtTbl: Proper error should appear if the connection to HIVE failed
JD-4716 ExtTbl: Error message following cast failure (reject) in select from external table is unhelpful
JD-4739 JOIN col type mismatch issues unhelpful error message "Undefined function '='"
JD-4773 Errors related to operations over external tables are not raised to caller
JD-4778 Cannot delete system table using the drop system table utility
JD-4782 Ext_table: REJECT_SAMPLE and REJECT_LIMIT_RATIO limits are not enforced and load passes when it should fail
JD-4793 The connector hangs when hive-jdbc driver is not found in classpath
JD-4797 Insert into should return errors from select/load instead of generic failure message
JD-4835 Scheduled Load mechanism not working as expected with post load file action
JD-4839 Failed to create Hive data source Hive on HDP 2.6.1
JD-4866 Getting error "could not find the virtual object of the virtual column" when reading from a cube
JD-4867 LDAP query fails with "operations error"
JD-4869 Query doesn't generate cube and nothing is reported in the logs
JD-4877 Query with HAVING COUNT(DISTINCT ...) fail with error. Index optimization for Group By is broken for this scenario

Minor Bug Fixes

JD-4461 ExtTbl: Fix "Creating an External table not allowed" message
JD-4717 ExtTbl: Reject count log message spaces fix
JD-4803 Insufficient logging for distributed stmts (e.g. show active queries) - missing info in cases of failure
JD-4852 SHOW EXTERNAL DATA SOURCES is missing under the SHOW help

Version 3.0.5

RELEASE DATE: Sep 3, 2017

Stability improvements and bug fixes

Improvements

JD-4820 Watchdog reset server in case of severe memory fragmentation
JD-4828 Maint stability - recover and skip errors related to specific operations or objects

Bug Fixes

JD-4821 Server appears hung when execution long queries due to memory cleanup cycle lock following dropping objects (tables, partitions or columns)

Version 3.0.4

RELEASE DATE: Aug 20TH, 2017

- Handle various casting issues related to INSERT INTO
- Loads scheduler issues
- Session files versions purge - fix session files scan overhead that caused delay on every request
- Additional bug fixes

New Features

JD-4163 Support inserting values via INSERT INTO ... VALUES (...)
JD-4704 SHOW EXTERNAL TABLES

Improvements

JD-4218 Allow downcast bigint/double to int/float in INSERT INTO
JD-4695 Support universal downcast type conversion in INSERT INTO (configured off)
JD-4779 Allow casting integer to float in INSERT INTO

Bug Fixes

JD-4520 Trailing spaces trimming by Tableau in where clause literal results in returning empty set - data type is reported as CHAR instead of VARCHAR
JD-4522 Server failure when executing query on view with UNION ALL that contains literals
JD-4638 Temporary files created during load at instance /tmp folder are not always removed
JD-4684 UNION ALL failure due to missing implicit casting of left to right clause
JD-4706 INSERT INTO request hang due to closing sockets of forked child process
JD-4725 Loader streamer page files cleanup may deletes temp files on concurrent loads
JD-4726 Loader error information is lost following exception
JD-4732 SHOW LOCAL CACHE return SHOW LOCAL CACHE EXTENDED results and vice versa
JD-4756 Scheduled loaded stop execution load jobs and never recover following HDFS errors
JD-4778 Admin utility cannot delete system table
JD-4783 Potential failure of Jethro Loader Scheduler service if error encountered during meta data read
JD-4785 Potential error in Jethro Loader Scheduler - file not close in case of read failure
JD-4786 Potential minor memory leak when reading a file in Jethro Loader Scheduler
JD-4788 Number of session files reach thousands due to accumulation of previous versions causing significant delay for every query when session is accessed. Previous versions of session files should be deleted by GC

Minor Bugs

JD-4591 Maint is getting stopped due to corrupted lock file without appropriate error message
JD-4610 Unclear error message on SHOW EXTERNAL DATA SOURCES when result is empty
JD-4713 Misspelled error messages

Version 3.0.3

RELEASE DATE: Jul 13TH, 2017

- Support LDAP authentication over SSL/TLS
- Support cubes for optimized union all flat queries
- Expend external connector environments support and improve Hive connector performance
- Scheduled loader can now run concurrent loads
- Performance improvements for queries grouped by datepart functions
- Important bug fixes related to cubes generation and cubes update that significantly improve cubes maintenance efficiency and reduce cube generation/update queue size
- 30+ additional bugs fixes

Improvements

JD-2922 GROUP BY optimization: use functional indexes for all datepart functions and complex timestamp functions expressions
JD-3872 Scheduled loads to support concurrent loads into different tables
JD-4400 Hive connector: performance improvements for fetch from external Hive table
JD-4557 Support LDAP authentication over SSL/TLS
JD-4570 Generate/match cubes for UNION ALL flat left/right queries following GB/AGG push down
JD-4595 External data source connector to support Java 1.7
JD-4621 External data source connector MapR support

Bug Fixes

JD-4005 Loader failure with core when writing the system table
JD-4190 Parameters BIGINT values always casted to INT
JD-4254 Maint resend cube update requests for cubes known to be too big
JD-4276 ExtTbl: show active queries failed while running an external query
JD-4326 Scheduled loads: list of file to load is not refreshed on next try following load fail
JD-4394 Union will fail if one side is integer literal and the other side is integer expression
JD-4397 Missing info in log: cube generation server port number not shown in maint log
JD-4402 Performance degradation in some queries with QLIK function (from version 3.0.0)
JD-4438 ExtTbl: missing supported casting operations in Hive connector
JD-4447 Show active queries and kill queries security deficiencies
JD-4452 ExtTbl: UNION ALL query from external table fails on internal error
JD-4462 Internal Fix for requestId handling
JD-4472 ExtTbl: rejected row count on FILL_NULL is wrong
JD-4476 Internal Fix in thread exception catching
JD-4485 GROUP BY query with hi cardinality count distinct aggregation from left join return wrong results when using partition level count distinct optimization
JD-4493 ExtTbl: UNION ALL query from external table fails with invalid column count error
JD-4505 Jethro Server port is not released following JethroServer restart during INSERT INTO operation
JD-4509 SQL syntax error cause server failure
JD-4511 Internal Fix: wrong assumption of argument of type ColumnCopy
JD-4515 Server failure upon intensive DDL operations
JD-4517 QLIK query over a view or sub-query cause server failure
JD-4529 Insert Into - Loader process is not always terminated when Server process stopped
JD-4539 Cubes are generated for system tables - should be avoided
JD-4558 Failures in delete obsolete cubes cause maint service shutdown
JD-4562 When updated cube is too big the subsequent cube updates commands fail to update the cubes
JD-4567 Server failure when query with count(*) from sub-query fetch the sub-query results from adaptive
JD-4568 Server failure when query where clause include unsupported sub-select = operation
JD-4614 IN/NOT IN will fail when checked against a list with aggregated values
JD-4618 Accuracy issue when reading sub-query from adaptive following specific push down aggregation optimization scenario
JD-4619 Cubes which needs update are sent several times to execution by maint service
JD-4623 Explicit IN subquery down cast behaves abnormally
JD-4626 Comparing literal to IN list cause server failure
JD-4627 Update cube fails when a schema change occur during cube update operation
JD-4640 Cubes generation flow does not detect that a cube was marked as too big and re-execute the cube query
JD-4666 LDAP group lookup fails for ldap user having distinguished name with special characters ("," "\" etc...)

Version 3.0.2

RELEASE DATE: Jun 6TH, 2017

- Improve Hive connector functionality and performance: with native Hive JDBC driver used by the connector advanced Hive JDBC URL syntax is now supported and the connector now works over Kerberized HDFS. Additional performance improvement is gained if using latest Hive JDBC.
- Various security, external table and other bug fixes

Improvements

JD-4482 Connector use native Hive JDBC available from the environment. Effect: connector can run on Kerberos environment and connector performance is improved

Bug Fixes

JD-4007 Query using range Index hangs
JD-4395 Count distinct query fails when matching cube with other aggregation
JD-4416 LDAP group name validation is case sensitive
JD-4419 Views authorization fails when underlying table is not authorized
JD-4426 Upgrade falsely generate additional copy of ssh authorization key
JD-4437 Accuracy issue for self-join queries with function on target list
JD-4440 JDBC packed with rpm should be upgraded to protobuf 2.5 (jdbc 2.0)
JD-4443 Multiple auditing log messages for single audit
JD-4473 External Tables: Server failure following INSERT INTO error when connector fails to run
JD-4475 CLONE of JD-4428 for 3.0.2
JD-4479 INSERT INTO reach deadlock in rare cases if executed following DROP TABLE/COLUMN
JD-4481 Service fails to start over Hortonwork environment following improper JAVA_HOME declaration
JD-4487 CLONE JD-4486 for 3.0.2
JD-4490 Drop on view set another view to "invalid" when column description is not same as column name
JD-4498 Server failure when receiving query with invalid syntax (brackets around target list)

Version 3.0.1

RELEASE DATE: May 23TH, 2017

Improved Hive connector performance enabling accelerated load from external tables and various connector related bug fixes.

Improvements

JD-4532 Hive connector Performance improvements

Bug Fixes

JD-4430 External Tables: Where fails when casting external table query from different types
JD-4442 External Tables: Reject FILL_NULL count limit is ignored
JD-4453 External Tables: kill query of "insert into" failed to stop the load from hive
JD-4459 External Tables: Insert into failure due to casting issue with "Invalid position specified for group-by column"

Version 3.0.0

RELEASE DATE: May 11TH, 2017

- Enhanced security with complete LDAP authentication and authentication with standard hierarchical permission model.
- External tables mapped to Hive table using Jethro-Hive connector.
- Load data using external table via standard INSERT INTO SELECT command.
- Self Join support.

New Features

JD-3077 Support INSERT INTO SELECT
JD-3632 LDAP authentication (release)
JD-3739 Support EXTERNAL DATA SOURCE and EXTERNAL TABLE
JD-3755 Security: Authorization Support (Permissions, Roles, Groups)
JD-3887 External Connector for HIVE
JD-3963 Security: Auditing

Version 2.0.4 enables system tables events creation by default. The mandatory requirement for system tables is to have loads scheduler services (JethroLoadsScheduler) run automatically. The service must be started and enabled to run automatically as follows:

1. Edit the service.ini file and set the third parameter for all active instances to yes
> vi $JETHRO_HOME/instances/services.ini
–> {instance-name}:port:yes:yes:yes

2. Start the Jethro loads scheduler service:
> service jethro start {instance-name} loadscheduler

Jethro 2.0 introduces auto micro cubes.

Jethro auto micro cubes brings the great performance value of pre-aggregated cubes, combined with the ability to automatically generate and transparently maintain those cube.
Cubes can be useful to accelerate performance for certain set of queries, mainly queries that are not highly filter and would normally scan large parts of the data set. Jethro optimizer combines cubes with indexing and caching technology to ensure interactive queries response time on wide range of use cases.

Issues list:

New Features

JD-2590 Auto Micro Cubes – Match and rewrite dynamic aggregations
JD-2609 Adaptive incremental – Expend support for additional queries types (CSH Hash)
JD-2786 System Tables
JD-2788 System Table for loader events
JD-2919 Auto Micro Cubes – Dynamic aggregation of count distinct queries
JD-2921 Auto Micro Cubes – Support hierarchy levels for timestamp columns
JD-2937 Auto Micro Cubes – Auto generate dynamic aggregations from incoming queries
JD-3110 Auto Micro Cubes – Manual cubes generation via GENERATE CUBES
JD-3111 Auto Micro Cubes – Support cube with where
JD-3112 Auto Micro Cubes – Find match for aggregators that has internal case expression
JD-3118 Auto Micro Cubes – Match count distinct aggregation queries without group by to cubes
JD-3411 Auto Micro Cubes – Allow aggregation queries without group by and with where to generate and match cubes
JD-3345 Auto Micro Cubes – Generate and match cubes for queries without measures
JD-3348 Auto Micro Cubes – SHOW CUBES and related cubes management commands

Improvements

JD-2838 Enable fetch and read adaptive cache files to/from local cache
JD-2839 Add section separators to the jethro loader report file
JD-2878 Add watchdog for JethroMaint
JD-2918 Optimized count distinct for CASE/IF in distinct aggregator
JD-2938 New instances parameters should be set with Yes as default in Service.ini
JD-3043 Count Distinct Optimization: Allow push group by functions and joins to upper query with count distinct using distinct values bitmaps and support adaptive incremental for count distinct
JD-3085 Improve adaptive write efficiency via large write chunks
JD-3183 Adaptive cache read: split each column read according to the size of current TupleSet parameter
JD-3210 Update incremental cubes by maint
JD-3285 Show active queries – add new option to status column: caching

Bug Fixes

JD-2204 Server failure when query is VERY long and includes text after “;”
JD-3137 Memory leak – related to IN with sub-query in outer query
JD-3142 Memory leak of Global UKI
JD-3363 Possible deadlock/leak in buckets merge
JD-3370 Join index not used when where clause contains OR not null
JD-3379 Server failure when query reads all adaptive columns into single buffer
JD-3467 Query failed with error – limit issue
JD-3507 Jethro server failed to execute query with IN literal left operand
JD-3514 Jethro Server failure – query hit partition holder internal error

Version 1.6.11

RELEASE DATE: NOV 9TH, 2016

Bug Fixes

JD-3461 Fix for JethroAdmin list-storage-instances
JD-3544 Query with UNION ALL as subquery stored in adaptive cache failed to update on data load/update
JD-3425 Loader doesn’t reject tokens with blank spaces loaded into numeric columns
JD-3524 Fix server failure in case there is filter with IN expression and a query on the right side of IN has filter of its own
JD-3438 Fix local-conf typos

Version 1.6.10

Data model conversion from previous versions is required.
Before starting service run: > Jethro U {instance-name} T

New Features

JD-2349 Support UNION ALL

Improvements

JD-2533 Column block encapsulation – store column block metadata and compressed value in a single file and avoid file append

Bug Fixes

JD-2522 Empty set result instead of exception that was raised – not consistent
JD-2637 Remove a warning message in partition pruning
JD-2645 Filter with “IN” does not work when the filter column is a partition key
JD-2653 Maint keeps life-long lock and old lock versions are not removed.
JD-2655 Query with quotes around the datatype in CAST fail
JD-2657 Sub-query adaptive causes simple query with sum and group by to fail. Return unclear error: CHECK failed: (index) lt (size())

Version 1.3.5

RELEASE DATE: JANUARY 28TH, 2016

Improvements

RELEASE DATE: DECEMBER 18TH, 2015

New Features

JD-2555 Support OFFSET clause in LIMIT clause

Improvements

JD-2192 Improve Show Local Cache information

Bug Fixes

JD-2542 Partition pruning – fix minor memory leak
JD-2554 Crash on partition pruning if table appears in more than one sub-query
JD-2572 Loader memory leak – keys pool doesn’t release temp buffer

Version 1.3.0

RELEASE DATE: DECEMBER 12TH, 2015

Backward Compatibility

Data model conversion from previous versions is required.
Before starting service run: > Jethro U {instance-name} K

New Features

JD-1526 Partitions pruning
JD-2362 Support Tableau Date data type usage
JD-2515 Support SQL functions “TIMESTAMPADD” and “TIMESTAMPDIFF”

Improvements

JD-2300 Integrate with libhdfs3 (beta mode)
JD-2354 update ODBC convert capabilities
JD-2379 Keep keys (values and indexes) in multiple files (file per block) and support keys recovery
JD-2398 Trivial Distributed locker based on shared file system
JD-2512 QLIK set analysis support: add support for DISTINCT operator with QLIK function
JD-2526 QLIK set analysis: Add ‘TOTAL! ‘ support
JD-2540 Update ODBC capabilities to reflect supported functions

Bug Fixes

JD-2370 CASE – if first then is NULL then CASE may fail due to type mismatch
JD-2486 Incoherent error message when performing a numeric function (e.g. sum) on a STRING column
JD-2501 Client hangs when connection or queries hangs/return after very long time (actual execution time is small)
JD-2502 libhdfs3 – Loader can’t load data files from HDFS
JD-2510 Monitor – No indication when the Jethro server and Maint were stopped
JD-2511 Monitor – No indication for Maint start in the service.log
JD-2520 QLIK set analysis – use left join instead of inner join
JD-2523 Crash happens when IN clause includes NULL value
JD-2524 Loader streamer creates more data blocks then set in config limit
JD-2535 QLIK set analysis – fix cases when original query doesn’t have target column

Version 1.2.1

RELEASE DATE: NOVEMBER 18TH, 2015

Improvements

JD-2503 Loader Usability – error messages
JD-2506 Improve loader memory control: release keys cached buffers if cache is full and allow using local cache during load

Bug Fixes

JD-2077 Loader: various issues with loader errors logging
JD-2307 Fix loader report: add number of rows removed from overwrite scenarios
JD-2418 Fix misleading message when input file is corrupt: Input row is longer than 10m bytes
JD-2455 Change error message in log file when user is running more than one loader on same table.
JD-2492 Loader report: indicate in report file that rows are being rejected and point to rejects file
JD-2508 Missing configuration in loader report file
JD-2509 Loader memory leak for Timestamp column

Version 1.2.0

RELEASE DATE: NOVEMBER 13TH, 2015

New Features

JD-2356 Primary Key
JD-2197 Join indexes
JD-2469 QLIK set analysis functionality in Jethro SQL (Alpha)

Improvements

JD-2470 Join after Dim GB Optimization – basic scenario (distinct values, no aggregators, single join)
JD-2487 Improve assume referential integrity (drop fact from join when possible)

Bug Fixes

JD-2483 Some aggregations are executed via non-optimized path (full scan) instead of index based aggregation
JD-2499 rpm upgrade removes Jethro monitor job
JD-2500 JOIN invalid qualifier crashes

Version 1.1.4

JD-2168 refactor adaptive rank calculation
JD-2005 Dynamic refresh of local cache based on blocks access frequency

Bugs

JD-2178 JethroODBC: ODBC driver should disable catalog support
JD-2176 Jethro initialization failed on test server
JD-2173 when adaptive cache deletes a query, it writes many junk lines in jethro.log
JD-2171 count(*) on columns from sub-query fails ” ‘Scalar’ node build failed”
JD-2117 Adaptive query cache – use FULL if can’t use INCREMENTAL
JD-1950 Query with IN returned wrong result on branch ‘JD-1947_non_opt_build’

Upgrade Instructions

Before upgrade: stop all loads and stop JethroLoadsScheduler service (service jethro stop instance-name] loadscheduler)
Confirm the load scheduler event drop folder is empty (ls storage-root-path]/instance-name]/loads/drop)

After upgrade to 3.4 it is mandatory to run upgrade tool over each existing instance.
Usage:
upgradeTo3.4_MultiSchema <instance> <ip/localhost>:<port> -u <user> -p <pass>

This tool create system schema "sys" and move jethro system tables to "sys" schema

Upgrade Instructions

Read the version specific upgrade notes which are relevant for your upgrade process, and perform all the steps which are required to be made, before starting the upgrade process.

Browser not supported