@@ -74,13 +74,13 @@ You can link against this library in your program at the following coordinates:
74
74
</tr >
75
75
<tr >
76
76
<td >
77
- <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.11<br >version: 2.8.2 </pre >
77
+ <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.11<br >version: 2.8.3 </pre >
78
78
</td >
79
79
<td >
80
- <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.12<br >version: 2.8.2 </pre >
80
+ <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.12<br >version: 2.8.3 </pre >
81
81
</td >
82
82
<td >
83
- <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.13<br >version: 2.8.2 </pre >
83
+ <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.13<br >version: 2.8.3 </pre >
84
84
</td >
85
85
</tr >
86
86
</table >
@@ -91,17 +91,17 @@ This package can be added to Spark using the `--packages` command line option. F
91
91
92
92
### Spark compiled with Scala 2.11
93
93
```
94
- $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.8.2
94
+ $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.8.3
95
95
```
96
96
97
97
### Spark compiled with Scala 2.12
98
98
```
99
- $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.8.2
99
+ $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.8.3
100
100
```
101
101
102
102
### Spark compiled with Scala 2.13
103
103
```
104
- $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.8.2
104
+ $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.8.3
105
105
```
106
106
107
107
## Usage
@@ -239,18 +239,18 @@ Cobrix's `spark-cobol` data source depends on the COBOL parser that is a part of
239
239
240
240
The jars that you need to get are:
241
241
242
- * spark-cobol_2.12-2.8.2 .jar
243
- * cobol-parser_2.12-2.8.2 .jar
242
+ * spark-cobol_2.12-2.8.3 .jar
243
+ * cobol-parser_2.12-2.8.3 .jar
244
244
245
245
> Versions older than 2.8.0 also need ` scodec-core_2.12-1.10.3.jar ` and ` scodec-bits_2.12-1.1.4.jar ` .
246
246
247
247
> Versions older than 2.7.1 also need ` antlr4-runtime-4.8.jar ` .
248
248
249
249
After that you can specify these jars in ` spark-shell ` command line. Here is an example:
250
250
```
251
- $ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.8.2
251
+ $ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.8.3
252
252
or
253
- $ spark-shell --master yarn --deploy-mode client --driver-cores 4 --driver-memory 4G --jars spark-cobol_2.12-2.8.2 .jar,cobol-parser_2.12-2.8.2 .jar
253
+ $ spark-shell --master yarn --deploy-mode client --driver-cores 4 --driver-memory 4G --jars spark-cobol_2.12-2.8.3 .jar,cobol-parser_2.12-2.8.3 .jar
254
254
255
255
Setting default log level to "WARN".
256
256
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
@@ -318,7 +318,7 @@ The fat jar will have '-bundle' suffix. You can also download pre-built bundles
318
318
319
319
Then, run ` spark-shell` or ` spark-submit` adding the fat jar as the option.
320
320
` ` ` sh
321
- $ spark-shell --jars spark-cobol_2.12_3.3-2.8.3 -SNAPSHOT-bundle.jar
321
+ $ spark-shell --jars spark-cobol_2.12_3.3-2.8.4 -SNAPSHOT-bundle.jar
322
322
` ` `
323
323
324
324
> < b> A note for building and running tests on Windows< /b>
@@ -1792,6 +1792,12 @@ at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:608)
1792
1792
A: Update hadoop dll to version 3.2.2 or newer.
1793
1793
1794
1794
## Changelog
1795
+ - #### 2.8.3 released 12 May 2025.
1796
+ - [ #759 ] ( https://github.com/AbsaOSS/cobrix/issues/759 ) Added the ability to run self-checks for custom record extractors:
1797
+ ``` scala
1798
+ .option(" enable_self_checks" , " true" )
1799
+ ```
1800
+
1795
1801
- #### 2.8.2 released 25 February 2025 .
1796
1802
- [# 744 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 744 ) Added the ability to specify default record length for the record length field mapping :
1797
1803
The default record length can be specified by assigning a value to the underscore key `"_"`. For example :
0 commit comments