Skip to content

Commit 4d6ba7d

Browse files
normanj-bitquillnormanj-bitquill
authored
Added end-to-end PPL tests for Spark (#1028)
* Added end-to-end PPL tests for Spark Signed-off-by: Norman Jordan <[email protected]> * Added instructions for adding end-to-end tests Signed-off-by: Norman Jordan <[email protected]> --------- Signed-off-by: Norman Jordan <[email protected]>
1 parent eff717a commit 4d6ba7d

File tree

455 files changed

+2791
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

455 files changed

+2791
-0
lines changed

‎docs/docker/integ-test/README.md

+80

‎e2e-test/src/test/resources/spark/queries/ppl/query_001.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | dedup 1 status | fields @timestamp, clientip, status, size | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_001.results

+3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
@timestamp,clientip,status,size
2+
2023-10-01T10:00:00.000Z,40.135.0.0,200,24736
3+
2023-10-01T10:20:00.000Z,247.37.0.0,304,0

‎e2e-test/src/test/resources/spark/queries/ppl/query_002.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | dedup status, size | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_002.results

+4
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
3+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
4+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_003.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | dedup 1 status keepempty=true | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_003.results

+3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_004.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | dedup status, size keepempty=true | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_004.results

+4
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
3+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
4+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_005.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | dedup 2 status | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_005.results

+4
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
4+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_006.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | dedup 2 status, size | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_006.results

+5
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
3+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
4+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
5+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_007.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | dedup 2 status, size keepempty=true | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_007.results

+5
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
3+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
4+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
5+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_008.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | sort status | fields @timestamp, clientip, status | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_008.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
@timestamp,clientip,status
2+
2023-10-01T10:00:00.000Z,40.135.0.0,200
3+
2023-10-01T10:05:00.000Z,232.0.0.0,200
4+
2023-10-01T10:10:00.000Z,26.1.0.0,200
5+
2023-10-01T10:15:00.000Z,247.37.0.0,200
6+
2023-10-01T10:25:00.000Z,252.0.0.0,200
7+
2023-10-01T10:20:00.000Z,247.37.0.0,304

‎e2e-test/src/test/resources/spark/queries/ppl/query_009.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | fields - @timestamp, clientip, status | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_009.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
request,size,year,day,month
2+
GET /images/hm_bg.jpg HTTP/1.0,24736,2023,1,10
3+
GET /images/hm_bg.jpg HTTP/1.0,24736,2023,1,10
4+
GET /images/hm_bg.jpg HTTP/1.0,24736,2023,1,10
5+
GET /french/splash_inet.html HTTP/1.0,3781,2023,1,10
6+
GET /images/hm_nbg.jpg HTTP/1.0,0,2023,1,10
7+
GET /images/hm_bg.jpg HTTP/1.0,24736,2023,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_010.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | eval new_time = @timestamp, new_clientip = clientip | fields - new_time, new_clientip, status | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_010.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
@timestamp,request,size,year,clientip,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,1,10
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,1,10
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,1,10
6+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,1,10
7+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_011.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | eval new_clientip = lower(clientip) | fields - new_clientip | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_011.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
@timestamp,request,size,year,clientip,status,day,month,new_clientip
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10,40.135.0.0
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10,232.0.0.0
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10,26.1.0.0
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10,247.37.0.0
6+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10,247.37.0.0
7+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10,252.0.0.0

‎e2e-test/src/test/resources/spark/queries/ppl/query_012.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | fields + @timestamp, clientip, status | fields - clientip, status | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_012.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
@timestamp
2+
2023-10-01T10:00:00.000Z
3+
2023-10-01T10:05:00.000Z
4+
2023-10-01T10:10:00.000Z
5+
2023-10-01T10:15:00.000Z
6+
2023-10-01T10:20:00.000Z
7+
2023-10-01T10:25:00.000Z

‎e2e-test/src/test/resources/spark/queries/ppl/query_013.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where status = 200 | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_013.results

+6
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
6+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_014.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where status != 200 | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_014.results

+2
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_015.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where size > 0 | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_015.results

+6
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
6+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_016.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where size <= 0 | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_016.results

+2
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_017.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where clientip = '236.14.2.0' | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_017.results

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
@timestamp,request,size,year,clientip,status,day,month

‎e2e-test/src/test/resources/spark/queries/ppl/query_018.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where size > 0 AND status = 200 OR clientip = '236.14.2.0' | head 100

‎e2e-test/src/test/resources/spark/queries/ppl/query_018.results

+6
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
6+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_019.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where size <= 0 AND like(request, 'GET%') | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_019.results

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
@timestamp,request,size,year,clientip,status,day,month

‎e2e-test/src/test/resources/spark/queries/ppl/query_020.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs status = 200 | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_020.results

+6
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
6+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_021.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs size > 0 AND status = 200 OR clientip = '236.14.2.0' | head 100

‎e2e-test/src/test/resources/spark/queries/ppl/query_021.results

+6
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
6+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_022.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs size <= 0 AND like(request, 'GET%') | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_022.results

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
@timestamp,request,size,year,clientip,status,day,month

‎e2e-test/src/test/resources/spark/queries/ppl/query_023.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where isempty(size)

‎e2e-test/src/test/resources/spark/queries/ppl/query_023.results

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
@timestamp,request,size,year,clientip,status,day,month

‎e2e-test/src/test/resources/spark/queries/ppl/query_024.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where ispresent(size)

‎e2e-test/src/test/resources/spark/queries/ppl/query_024.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
6+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10
7+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_025.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where isnull(size) | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_025.results

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
@timestamp,request,size,year,clientip,status,day,month

‎e2e-test/src/test/resources/spark/queries/ppl/query_026.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where isnotnull(size) | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_026.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
6+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10
7+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_027.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where like(request, 'GET%') | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_027.results

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
@timestamp,request,size,year,clientip,status,day,month

‎e2e-test/src/test/resources/spark/queries/ppl/query_028.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where like(request, '%bordeaux%') | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_028.results

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
@timestamp,request,size,year,clientip,status,day,month

‎e2e-test/src/test/resources/spark/queries/ppl/query_029.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | where case(status = 200, 'success' else 'failed') = 'success' | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_029.results

+6
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
@timestamp,request,size,year,clientip,status,day,month
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10
6+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10

‎e2e-test/src/test/resources/spark/queries/ppl/query_030.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | eval h = "Hello", w = "World" | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_030.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
@timestamp,request,size,year,clientip,status,day,month,h,w
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10,Hello,World
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10,Hello,World
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10,Hello,World
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10,Hello,World
6+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10,Hello,World
7+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10,Hello,World

‎e2e-test/src/test/resources/spark/queries/ppl/query_031.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | eval @h = "Hello" | eval @w = "World" | fields @timestamp, @h, @w

‎e2e-test/src/test/resources/spark/queries/ppl/query_031.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
@timestamp,@h,@w
2+
2023-10-01T10:00:00.000Z,Hello,World
3+
2023-10-01T10:05:00.000Z,Hello,World
4+
2023-10-01T10:10:00.000Z,Hello,World
5+
2023-10-01T10:15:00.000Z,Hello,World
6+
2023-10-01T10:20:00.000Z,Hello,World
7+
2023-10-01T10:25:00.000Z,Hello,World

‎e2e-test/src/test/resources/spark/queries/ppl/query_032.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | eval newF = clientip | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_032.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
@timestamp,request,size,year,clientip,status,day,month,newF
2+
2023-10-01T10:00:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,40.135.0.0,200,1,10,40.135.0.0
3+
2023-10-01T10:05:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,232.0.0.0,200,1,10,232.0.0.0
4+
2023-10-01T10:10:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,26.1.0.0,200,1,10,26.1.0.0
5+
2023-10-01T10:15:00.000Z,GET /french/splash_inet.html HTTP/1.0,3781,2023,247.37.0.0,200,1,10,247.37.0.0
6+
2023-10-01T10:20:00.000Z,GET /images/hm_nbg.jpg HTTP/1.0,0,2023,247.37.0.0,304,1,10,247.37.0.0
7+
2023-10-01T10:25:00.000Z,GET /images/hm_bg.jpg HTTP/1.0,24736,2023,252.0.0.0,200,1,10,252.0.0.0

‎e2e-test/src/test/resources/spark/queries/ppl/query_033.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | eval newF = clientip | fields clientip, newF | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_033.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
clientip,newF
2+
40.135.0.0,40.135.0.0
3+
232.0.0.0,232.0.0.0
4+
26.1.0.0,26.1.0.0
5+
247.37.0.0,247.37.0.0
6+
247.37.0.0,247.37.0.0
7+
252.0.0.0,252.0.0.0

‎e2e-test/src/test/resources/spark/queries/ppl/query_034.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | eval f = size | where f > 1 | sort f | fields size, clientip, status | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_034.results

+6
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
size,clientip,status
2+
3781,247.37.0.0,200
3+
24736,40.135.0.0,200
4+
24736,232.0.0.0,200
5+
24736,26.1.0.0,200
6+
24736,252.0.0.0,200

‎e2e-test/src/test/resources/spark/queries/ppl/query_035.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | eval f = status * 2 | eval h = f * 2 | fields status, f, h | head 10

‎e2e-test/src/test/resources/spark/queries/ppl/query_035.results

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
status,f,h
2+
200,400,800
3+
200,400,800
4+
200,400,800
5+
200,400,800
6+
304,608,1216
7+
200,400,800

‎e2e-test/src/test/resources/spark/queries/ppl/query_036.ppl

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
source = dev.default.http_logs | eval f = size * 2, h = status | stats sum(f) by h

0 commit comments

Comments
 (0)