Autoscaling using SolrCloud8.5 on AWS EKS - issue with Node Added trigger

トピック作成者：Mangla,Kirti (2020/06/03 03:58 投稿)

Open

Hi,

I have been trying to enable autoscaling on SolrCloud 8.5, with Node Added trigger and Node Lost trigger. The SolrCloud is running on AWS EKS pods, with 2 nodes minimum.

I have added NodeAddedTrigger. My autoscaling API response looks like as in the attached file.

Whenever I scale up the SolrCloud replicas on EKS, new nodes are added to the cluster but the Node Added trigger throws below error:

org.apache.solr.common.SolrException: Unexpected exception while processing event: {
"id":"c889e6ef3b34eTcc9nazth0kbod28rj2zc84n0b",
"source":"node_added_trigger",
"eventTime":3527913768203086,
"eventType":"NODEADDED",
"properties":{
"eventTimes":[3527913768203086],
"preferredOperation":"addreplica",
"_enqueuetime":3527918773192489,
"nodeNames":["solrcloud-2.solrcluster:8983_solr"],
"replicaType":"NRT"}}
at org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:161)
at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:326)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.solr.common.SolrException: org.apache.solr.common.SolrException: Error getting remote info
at org.apache.solr.common.cloud.rule.ImplicitSnitch.getTags(ImplicitSnitch.java:78)
at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider.fetchTagValues(SolrClientNodeStateProvider.java:139)
at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider.getNodeValues(SolrClientNodeStateProvider.java:128)
at org.apache.solr.client.solrj.cloud.autoscaling.Row.<init>(Row.java:71)
at org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.<init>(Policy.java:575)
at org.apache.solr.client.solrj.cloud.autoscaling.Policy.createSession(Policy.java:396)
at org.apache.solr.client.solrj.cloud.autoscaling.Policy.createSession(Policy.java:358)
at org.apache.solr.client.solrj.cloud.autoscaling.PolicyHelper$SessionRef.createSession(PolicyHelper.java:492)
at org.apache.solr.client.solrj.cloud.autoscaling.PolicyHelper$SessionRef.get(PolicyHelper.java:457)
at org.apache.solr.client.solrj.cloud.autoscaling.PolicyHelper.getSession(PolicyHelper.java:513)
at org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:90)
... 7 more
Caused by: org.apache.solr.common.SolrException: Error getting remote info
at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider$AutoScalingSnitch.getRemoteInfo(SolrClientNodeStateProvider.java:364)
at org.apache.solr.common.cloud.rule.ImplicitSnitch.getTags(ImplicitSnitch.java:76)
... 17 more
Caused by: org.apache.solr.common.SolrException: Could not get remote info after many retries on NoHttpResponseException
at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider$AutoScalingSnitch.getRemoteInfo(SolrClientNodeStateProvider.java:335)
... 18 more

Looking for help on the subject.
Please let me know for doubts.

Thanks,
Kirti Mangla

If you are not the intended recipient or have received this message in error, please notify the sender and permanently delete this message and any attachments.

添付ファイル：

12 solr-autoscaling-api-response.txt

返信投稿者：Mangla,Kirti (2020/06/03 23:38 投稿)

Hi,

Looking for help on this issue.
Anyone has faced this problem?

Thanks,
Kirti Mangla
Software Engineer- Gartner Digital Markets - GetApp
Two Horizon Center, Golf Course Road, Gurgaon, India
Direct: +91124-4795963
[logo_small]

From: Mangla,Kirti
Sent: Wednesday, June 3, 2020 12:29 AM
To: solr-user@lucene.apache.org
Subject: Autoscaling using SolrCloud8.5 on AWS EKS - issue with Node Added trigger

Hi,

I have been trying to enable autoscaling on SolrCloud 8.5, with Node Added trigger and Node Lost trigger. The SolrCloud is running on AWS EKS pods, with 2 nodes minimum.
I have added NodeAddedTrigger. My autoscaling API response looks like as in the attached file.

Whenever I scale up the SolrCloud replicas on EKS, new nodes are added to the cluster but the Node Added trigger throws below error:

Looking for help on the subject.
Please let me know for doubts.

Thanks,
Kirti Mangla

If you are not the intended recipient or have received this message in error, please notify the sender and permanently delete this message and any attachments.

添付ファイル：

11 solr-autoscaling-api-response.txt

11 image002.jpg

返信投稿者：Mangla,Kirti (2020/06/05 15:07 投稿)

Hi,

I am working with solr 8.5.2 on AWS EKS.
Autoscaling trigger NodeAddedTrigger is not working and throwing Java error
Caused by: org.apache.solr.common.SolrException: org.apache.solr.common.SolrException: Error getting remote info

Looking for some help for troubleshooting it.

Thanks,
Kirti Mangla
Software Engineer- Gartner Digital Markets - GetApp
Two Horizon Center, Golf Course Road, Gurgaon, India
Direct: +91124-4795963
[logo_small]

From: Mangla,Kirti
Sent: Wednesday, June 3, 2020 12:29 AM
To: solr-user@lucene.apache.org
Subject: Autoscaling using SolrCloud8.5 on AWS EKS - issue with Node Added trigger

Hi,

Whenever I scale up the SolrCloud replicas on EKS, new nodes are added to the cluster but the Node Added trigger throws below error:

Looking for help on the subject.
Please let me know for doubts.

Thanks,
Kirti Mangla

If you are not the intended recipient or have received this message in error, please notify the sender and permanently delete this message and any attachments.

トピックへ返信するには、ログインが必要です。

トピック一覧へ戻る