一、高级查询Query DSL
Elasticsearch 高级查询Query DSL:
1、查询接口的步骤
一个查询接口的基本步骤如下:
、创建 SearchRequest搜索请求
创建 SearchRequest 搜索请求,如果不带参数,表示查询所有 索引
、创建 SearchSourceBuilder条件构造
创建 SearchSourceBuilder条件构造,构建搜索的条件。
添加大部分查询参数到 SearchSourceBuilder,还可以接收 QueryBuilders构建的查询参数。、将 Search SourceBuilder 添加到 Search Request 中
、执行查询
、解析查询结果
其中,第二步和第五步最为关键。
下面直接上代码,语法使用就不解释了。
2、查询所有match_all
使用 match_all,默认只会返回 10条数据。
2.1 全量查询
@Test
public void testMatchAll() throws IO Exception {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求
SearchRequest searchRequest = new SearchRequest();
searchRequest.indices("db_idx");//指定要查询的索引
//.创建 SearchSourceBuilder条件构造。builder模式这里就先不简写了
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
MatchAllQueryBuilder matchAllQueryBuilder = QueryBuilders.matchAllQuery();
searchSourceBuilder.query(matchAll Query Builder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println(searchResponse);
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println(hits.getTotalHits());
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
hits.forEach(p -> System.out.println("文档原生信息:" + p.getSourceAsString()));
}
2.2 分页查询
- size 关键字:指定查询结果中返回指定条数。 默认返回值10条。
- from 关键字:用来指定起始返回位置,和size关键字连用可实现分页效果
@Test
public void testMatchAllPage() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求
SearchRequest searchRequest = new SearchRequest();
searchRequest.indices("db_idx");//指定要查询的索引
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder()
.query(QueryBuilders.matchAllQuery());
//设置分页
searchSourceBuilder.from();
searchSourceBuilder.size();
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
hits.forEach(p -> System.out.println("文档原生信息:" + p.getSourceAsString()));
}
3、数据排序
@Test
public void testSortByAge() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求
SearchRequest searchRequest = new SearchRequest();
searchRequest.indices("db_idx");//指定要查询的索引
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder()
.query(QueryBuilders.matchAllQuery());
//年龄倒序
searchSourceBuilder. Sort ("age", SortOrder.DESC);
searchSourceBuilder.sort("id", SortOrder.DESC);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
hits.forEach(p -> System.out.println("文档原生信息:" + p.getSourceAsString()));
}
4、数据过滤
数据过滤就是 返回我们指定的字段。
@Test
public void testSource() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求
SearchRequest searchRequest = new SearchRequest();
searchRequest.indices("db_idx");//指定要查询的索引
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder()
.query(QueryBuilders.matchAllQuery());
//指定需要返回或者排除的字段
String [] includes = {
"id", "name"};
String[] excludes = {
};
searchSourceBuilder.fetchSource(includes, excludes);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
hits.forEach(p -> System.out.println("文档原生信息:" + p.getSourceAsString()));
}
5、match 查找
match在匹配时会对所查找的关键词进行分词,然后按分词匹配查找。
@Test
public void testMatch() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("db_idx");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//match 查找
MatchQueryBuilder matchQueryBuilder = QueryBuilders.matchQuery("address", "王者打野");
matchQueryBuilder. operator (Operator.OR);
searchSourceBuilder.query(matchQueryBuilder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
hits.forEach(p -> System.out.println("文档原生信息:" + p.getSourceAsString()));
}
6、多字段查询multi_match
multi_match 关键字:可以根据字段类型,决定是否使用分词查询,得分最高的在前面。
@Test
public void testMultiMatch() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("db_idx");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//MultiMatch 查找
MultiMatchQueryBuilder multiMatchQuery = QueryBuilders.multiMatchQuery("王者辅助"," address ", "desc");
multiMatchQuery.operator(Operator.OR);
searchSourceBuilder.query(multiMatchQuery);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
hits.forEach(p -> System.out.println("文档原生信息:" + p.getSourceAsString()));
}
7、精确查询Term
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//Term 查找
//TermQueryBuilder termQueryBuilder = QueryBuilders.termQuery("age",);
TermQueryBuilder termQueryBuilder = QueryBuilders.termQuery("address.keyword", "三国演义小乔");
searchSourceBuilder.query(termQueryBuilder);
8、范围查询range
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//Range 查找
RangeQueryBuilder rangeQueryBuilder = QueryBuilders.rangeQuery("age");
rangeQueryBuilder.gte();
rangeQueryBuilder.lt();
searchSourceBuilder.query(rangeQueryBuilder);
9、日期查询range
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("product");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//日期Range 查找
RangeQueryBuilder rangeQueryBuilder = QueryBuilders.rangeQuery("date"); //date字段
rangeQueryBuilder.lt("now‐y");
searchSourceBuilder.query(rangeQueryBuilder);
10、多个id查询
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//多个id 查找
IdsQueryBuilder idsQueryBuilder = QueryBuilders.idsQuery();
idsQueryBuilder.addIds("", "5", "1111");
searchSourceBuilder.query(idsQueryBuilder);
11、高亮查询
@Test
public void testHighlight() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("db_idx");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//Term 查找
TermQueryBuilder termQueryBuilder = QueryBuilders.termQuery("address", "王者");
searchSourceBuilder.query(termQueryBuilder);
//自定义高亮 查找
HighlightBuilder highlightBuilder = new HighlightBuilder();
highlightBuilder.preTags("<font color='red'>");
highlightBuilder.postTags("</font>");
highlightBuilder.field("address");
highlightBuilder.requireFieldMatch(false); //多字段时,需要设置为false
highlightBuilder.field("desc");
searchSourceBuilder.highlighter(highlightBuilder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
hits.forEach(p -> {
System.out.println("文档原生信息:" + p.getSourceAsString());
System.out.println("高亮信息:" + p.getHighlightFields());
});
}
12、布尔查询Bool
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//Bool查找
BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery();
// and
//boolQueryBuilder.must(QueryBuilders.rangeQuery("age").gte());
//boolQueryBuilder.must(QueryBuilders.matchQuery("sex", ""));
// or
boolQueryBuilder.should(QueryBuilders.rangeQuery("age").gte());
boolQueryBuilder.should(QueryBuilders.matchQuery("sex", ""));
searchSourceBuilder.query(boolQueryBuilder);
13、模糊查询
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//Fuzzy 查找
FuzzyQueryBuilder fuzzyQueryBuilder = QueryBuilders.fuzzyQuery("name", "张").fuzziness(Fuzziness.ONE);
searchSourceBuilder.query(fuzzyQueryBuilder);
二、聚合操作
ElasticSearch聚合操作:
1、Metric Aggregation
Metric Aggregation 一些数学运算,可以对文档字段进行统计分析。
1.1 查询员工的最低最高和平均工资
@Test
public void testAgg() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("employees");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//查询员工的最低最高和平均工资
MaxAggregationBuilder maxAggregationBuilder = AggregationBuilders.max("maxSalary").field("salary");
MinAggregationBuilder minAggregationBuilder = AggregationBuilders.min("minSalary").field("salary");
AvgAggregationBuilder avgAggregationBuilder = AggregationBuilders.avg("avgSalary").field("salary");
searchSourceBuilder.aggregation(maxAggregationBuilder);
searchSourceBuilder.aggregation(minAggregationBuilder);
searchSourceBuilder.aggregation(avgAggregationBuilder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println(searchResponse);
System.out.println("花费的时长:" + searchResponse.getTook());
Aggregations aggregations = searchResponse.getAggregations();
System.out.println("aggregations:" + aggregations);
ParsedMax maxSalary = aggregations.get("maxSalary");
ParsedMin minSalary = aggregations.get("minSalary");
ParsedAvg avgSalary = aggregations.get("avgSalary");
System.out.println("maxSalary:" + maxSalary);
System.out.println("最低工资" + maxSalary.getValue());
System.out.println("最高工资" + minSalary.getValue());
System.out.println("平均工资" + avgSalary.getValue());
}
1.2 对salary进行统计
@Test
public void testAgg() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("employees");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//对salary进行统计
StatsAggregationBuilder statsAggregationBuilder = AggregationBuilders.stats("statSalary").field("salary");
searchSourceBuilder.aggregation(statsAggregationBuilder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
Aggregations aggregations = searchResponse.getAggregations();
System.out.println("aggregations:" + aggregations);
ParsedStats statSalary = aggregations.get("statSalary");
System.out.println("统计个数" + statSalary.getCount());
System.out.println("平均工资" + statSalary.getAvg());
System.out.println("最高工资" + statSalary.getMaxAsString()); //可以转String
System.out.println("最低工资" + statSalary.getMin());
System.out.println("工资之和" + statSalary.getSum());
}
1.3 cardinate对搜索结果去重统计
@Test
public void testAgg() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("employees");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//cardinate对搜索结果去重统计
CardinalityAggregationBuilder cardinalityAggregationBuilder = AggregationBuilders.cardinality("jobCardinate").field("job.keyword");
searchSourceBuilder.aggregation(cardinalityAggregationBuilder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
Aggregations aggregations = searchResponse.getAggregations();
System.out.println("aggregations:" + aggregations);
ParsedCardinality cardinality = aggregations.get("jobCardinate");
System.out.println("字段:" + cardinality.getName());
System.out.println("不重复的个数" + cardinality.getValue());
}
2、Bucket Aggregation
Bucket Aggregation:按照一定的规则,将文档分配到不同的桶中,每一个桶关联一个 key,从而达到分类的目的。类比Mysql中的group by操作。
2.1 获取 job的分类信息
@Test
public void testAgg() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("employees");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
//获取 job的分类信息
TermsAggregationBuilder termsAggregationBuilder = AggregationBuilders.terms("jobGroup").field("job.keyword");
searchSourceBuilder.aggregation(termsAggregationBuilder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
Aggregations aggregations = searchResponse.getAggregations();
System.out.println("aggregations:" + aggregations);
ParsedTerms jobGroup = aggregations.get("jobGroup");
System.out.println("字段:" + jobGroup.getName());
List<? extends Terms.Bucket> buckets = jobGroup.getBuckets();
for (Terms.Bucket bucket : buckets) {
System.out.println("getKey:" + bucket.getKey());
System.out.println("getKeyAsString:" + bucket.getKeyAsString());
System.out.println("getDocCount:" + bucket.getDocCount());
}
}
2.2 限定聚合范围
@Test
public void testAgg() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("employees");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
RangeQueryBuilder rangeQueryBuilder = QueryBuilders.rangeQuery("salary").gte();
searchSourceBuilder.query(rangeQueryBuilder);
//获取 job的分类信息
TermsAggregationBuilder termsAggregationBuilder = AggregationBuilders.terms("jobGroup")
.field("job.keyword")
.size()
.order(BucketOrder.aggregation("_count", true));
searchSourceBuilder.aggregation(termsAggregationBuilder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
//聚合信息
Aggregations aggregations = searchResponse.getAggregations();
System.out.println("aggregations:" + aggregations);
ParsedTerms jobGroup = aggregations.get("jobGroup");
System.out.println("字段:" + jobGroup.getName());
List<? extends Terms.Bucket> buckets = jobGroup.getBuckets();
for (Terms.Bucket bucket : buckets) {
System.out.println("getKey:" + bucket.getKey());
System.out.println("getKeyAsString:" + bucket.getKeyAsString());
System.out.println("getDocCount:" + bucket.getDocCount());
}
}
2.3 Range 示例:按照工资的 Range 分桶
@Test
public void testAgg() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("employees");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
// Salary Range分桶,可以自己定义 key
RangeAggregationBuilder rangeAggregationBuilder = AggregationBuilders.range("salary_range")
.field("salary")
.addUnboundedTo()
.addRange(, 20000)
.addUnboundedFrom(">", 20000);
searchSourceBuilder.aggregation(rangeAggregationBuilder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
//聚合信息
Aggregations aggregations = searchResponse.getAggregations();
System.out.println("aggregations:" + aggregations);
ParsedRange salaryRange = aggregations.get("salary_range"); //注意类型
System.out.println("字段:" + salaryRange.getName());
List<? extends Range.Bucket> buckets = salaryRange.getBuckets();
for (Range.Bucket bucket : buckets) {
System.out.println("getKey:" + bucket.getKey());
System.out.println("getKeyAsString:" + bucket.getKeyAsString());
System.out.println("getDocCount:" + bucket.getDocCount());
System.out.println("getFromAsString:" + bucket.getFromAsString());
System.out.println("getToAsString:" + bucket.getToAsString());
}
}
2.4 Histogram示例:按照工资的间隔分桶
// Histogram示例:按照工资的间隔分桶
HistogramAggregationBuilder histogramAggregationBuilder = AggregationBuilders.histogram("salary_histrogram")
.field("salary")
.interval()
.extendedBounds(, 100000);
searchSourceBuilder.aggregation(histogramAggregationBuilder);
.5 date_histogram 根据年月日做统计和上面类似,可自定义时间格式
2.6 top_hits示例:
top_hits应用场景:当获取分桶后,桶内最匹配的顶部文档列表。
@Test
public void testAgg() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("employees");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
// top_hits示例:指定size,不同工种中,年纪最大的个员工的具体信息
TopHitsAggregationBuilder topHitsAggregationBuilder = AggregationBuilders.topHits("old_employee")
.size()
.sort("age", SortOrder.DESC);
TermsAggregationBuilder termsAggregationBuilder = AggregationBuilders.terms("jobs")
.field("job.keyword")
.subAggregation(topHitsAggregationBuilder); //嵌套聚合
searchSourceBuilder.aggregation(termsAggregationBuilder);
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
//聚合信息
Aggregations aggregations = searchResponse.getAggregations();
System.out.println("aggregations:" + aggregations);
ParsedTerms jobs = aggregations.get("jobs"); //注意类型
System.out.println("字段:" + jobs.getName());
List<? extends Terms.Bucket> buckets = jobs.getBuckets();
for (Terms.Bucket bucket : buckets) {
System.out.println("getKey:" + bucket.getKey());
System.out.println("getKeyAsString:" + bucket.getKeyAsString());
System.out.println("getDocCount:" + bucket.getDocCount());
//嵌套的信息
ParsedTopHits oldEmployee = bucket.getAggregations().get("old_employee");
SearchHits employeeHits = oldEmployee.getHits();
System.out.println(" hits.getTotalHits().value:" + hits.getTotalHits().value);
for (SearchHit employeeHit : employeeHits) {
System.out.println(" employeeHit.getSourceAsString():" + employeeHit.getSourceAsString());
}
}
}
3、Pipeline Aggregation
Pipeline Aggregation:支持对聚合分析的结果,再次进行聚合分析。
3.1 min_bucket示例:最小值
在员工数最多的工种里,找出平均工资最低的工种
public void testAgg() throws IOException {
RestHighLevelClient restHighLevelClient = ESUtil.getRestHighLevelClient();
//.创建 SearchRequest搜索请求,并指定要查询的索引
SearchRequest searchRequest = new SearchRequest("employees");
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
// min_bucket示例:平均工资最低的工种
AvgAggregationBuilder avgAggregationBuilder = AggregationBuilders.avg("avg_salary").field("salary");
TermsAggregationBuilder termsAggregationBuilder = AggregationBuilders.terms("jobs")
.field("job.keyword")
.size()
.subAggregation(avgAggregationBuilder); //嵌套聚合
searchSourceBuilder.aggregation(termsAggregationBuilder);
// 添加 bucket pipeline(min_bucket)
searchSourceBuilder.aggregation(new MinBucketPipelineAggregationBuilder("min_salary_by_job", "jobs>avg_salary"));
//.将 SearchSourceBuilder 添加到 SearchRequest中
searchRequest.source(searchSourceBuilder);
//.执行查询
SearchResponse searchResponse = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
//.解析查询结果
System.out.println("花费的时长:" + searchResponse.getTook());
SearchHits hits = searchResponse.getHits();
System.out.println("符合条件的总文档数量:" + hits.getTotalHits().value);
//聚合信息
Aggregations aggregations = searchResponse.getAggregations();
System.out.println("aggregations:" + aggregations);
ParsedTerms jobs = aggregations.get("jobs"); //注意类型
System.out.println("字段:" + jobs.getName());
List<? extends Terms.Bucket> buckets = jobs.getBuckets();
for (Terms.Bucket bucket : buckets) {
System.out.println("getKey:" + bucket.getKey());
System.out.println("getKeyAsString:" + bucket.getKeyAsString());
System.out.println("getDocCount:" + bucket.getDocCount());
//嵌套的信息
ParsedAvg avgSalary = bucket.getAggregations().get("avg_salary");
System.out.println(" hits.getTotalHits().value:" + avgSalary.getValue());
}
}
3.2 Stats示例:统计分析
//.创建 SearchSourceBuilder条件构造。
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
// Stats示例:统计分析:平均工资的统计分析
AvgAggregationBuilder avgAggregationBuilder = AggregationBuilders.avg("avg_salary").field("salary");
TermsAggregationBuilder termsAggregationBuilder = AggregationBuilders.terms("jobs")
.field("job.keyword")
.size()
.subAggregation(avgAggregationBuilder); //嵌套聚合
searchSourceBuilder.aggregation(termsAggregationBuilder);
// 添加 bucket pipeline(stats_bucket)
searchSourceBuilder.aggregation(new StatsBucketPipelineAggregationBuilder("stats_salary_by_job", "jobs>avg_salary"));
到此,Java 操作 RestHighLevelClient查询基本就 ok了。
总结如下:
- 写好 ES语句很关键,然后通过 客户端编写出来就简单了。
- 创建 SearchSourceBuilder条件构造,构建搜索的条件很重要,根据业务构造r条件变化多端。
- 不管是 Query DSL还是 聚合操作,通过 ES语句的结果来编写 SearchResponse的解析查询结果就很容易了,注意里边的类型。
– 求知若饥,虚心若愚。