官术网_书友最值得收藏!

Using SQL subqueries

It is also possible to use subqueries in ApacheSparkSQL. In the following example, a SQL query uses an anonymous inner query in order to run aggregations on Windows. The encapsulating query is making use of the virtual/temporal result of the inner query, basically removing empty columns:

val result = spark.sql("""
SELECT * from (
SELECT
min(temperature) over w as min_temperature,
max(temperature) over w as max_temperature,
min(voltage) over w as min_voltage,
max(voltage) over w as max_voltage,
min(flowrate) over w as min_flowrate,
max(flowrate) over w as max_flowrate,
min(frequency) over w as min_frequency,
max(frequency) over w as max_frequency,
min(hardness) over w as min_hardness,
max(hardness) over w as max_hardness,
min(speed) over w as min_speed,
max(speed) over w as max_speed
FROM washing_flat
WINDOW w AS (ORDER BY ts ROWS BETWEEN CURRENT ROW AND 10 FOLLOWING)
)
WHERE min_temperature is not null
AND max_temperature is not null
AND min_voltage is not null
AND max_voltage is not null
AND min_flowrate is not null
AND max_flowrate is not null
AND min_frequency is not null
AND max_frequency is not null
AND min_hardness is not null
AND min_speed is not null
AND max_speed is not null
""")

The result of the subqueries is as follows:

主站蜘蛛池模板: 保定市| 龙南县| 呈贡县| 清徐县| 姜堰市| 电白县| 苍南县| 元氏县| 黔东| 敦煌市| 通许县| 晴隆县| 兴海县| 铜山县| 富宁县| 如东县| 田林县| 南涧| 乐安县| 油尖旺区| 灵山县| 三都| 门源| 浮山县| 池州市| 商丘市| 安塞县| 孟州市| 会同县| 双辽市| 芜湖市| 敦化市| 洛扎县| 台中县| 尖扎县| 义乌市| 富蕴县| 兴业县| 滁州市| 青龙| 邳州市|