Problem with validation.

Message boards : Number crunching : Problem with validation.
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 6 · Next

AuthorMessage
Henk Haneveld

Send message
Joined: 24 Jul 23
Posts: 2
Credit: 113,244
RAC: 0
Message 150 - Posted: 26 Jul 2023, 6:25:32 UTC

The minimum quorum is set to 2 but if 1 has been returned it is validated and the other workunit is Cancelled by server.

Either change the initial replication from 2 to 1 or change the validation process.
ID: 150 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Werinbert

Send message
Joined: 25 Jul 23
Posts: 2
Credit: 1,001,716
RAC: 0
Message 151 - Posted: 26 Jul 2023, 7:52:31 UTC

I am seeing this same problem. Furthermore if the task was started and completed but returned minutes after the wingman it gets no credit for work done. It needs to be fixed.
ID: 151 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Demis
Project tester
Volunteer developer
Volunteer tester

Send message
Joined: 14 Jun 23
Posts: 259
Credit: 3,025,658
RAC: 20,228
Message 153 - Posted: 26 Jul 2023, 9:45:02 UTC - in response to Message 150.  

Thank You for your message.

Yes. There is such a problem.
On short tests, I did not see it.

We are looking into how this can be fixed.
This may take time.

We are very sorry.
ID: 153 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Natalia Makarova
Volunteer moderator
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 14 Jun 23
Posts: 419
Credit: 280,293
RAC: 0
Message 156 - Posted: 26 Jul 2023, 17:58:41 UTC - in response to Message 153.  

Demis
I propose to refuse quorum=2.
The program has been tested for a long time and works stably.
ID: 156 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Demis
Project tester
Volunteer developer
Volunteer tester

Send message
Joined: 14 Jun 23
Posts: 259
Credit: 3,025,658
RAC: 20,228
Message 157 - Posted: 26 Jul 2023, 20:13:30 UTC - in response to Message 156.  

Maybe.
I think the current task needs to be worked on to the end

In one day, we counted more than 20,000 tasks.
If we continue at the same speed, then in 10 days 200,000 will be ready, and so on.

Yes. There is a problem. I'm still thinking about how to solve it.
I propose to count to the end. And release the next task with a quorum of 1.

It is interesting to hear the opinion of crunchers. How can we do better?
ID: 157 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Natalia Makarova
Volunteer moderator
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 14 Jun 23
Posts: 419
Credit: 280,293
RAC: 0
Message 163 - Posted: 26 Jul 2023, 23:49:44 UTC - in response to Message 157.  

Demis
The problem with the deadline is described here
https://boinc.termit.me/adsl/forum_thread.php?id=12&postid=161

You wrote that you launched a batch of 250,000 WUs.
With a quorum of 2, 500,000 WUs will need to be calculated.
This is a lot.
It will count for almost a month.
And existing problems make calculations difficult.
ID: 163 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Natalia Makarova
Volunteer moderator
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 14 Jun 23
Posts: 419
Credit: 280,293
RAC: 0
Message 164 - Posted: 26 Jul 2023, 23:59:58 UTC - in response to Message 157.  
Last modified: 27 Jul 2023, 0:31:09 UTC

It is interesting to hear the opinion of crunchers. How can we do better?

I think crunchers don't need quorum issues and deadline issues.

I propose to stop issuing tasks, wait for all the tasks that are at the crunchers.
Then solve the problem with the deadline and launch a new batch of tasks with a quorum of 1.

At the same time it is necessary to solve the problem with communication (message notifications from subscribed topics).

PS. Since the deadline is now valid not for 7 days, but only for a day, all tasks from crunchers will have to wait a day.
ID: 164 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 15 Jun 23
Posts: 22
Credit: 10,451,933
RAC: 19,172
Message 166 - Posted: 27 Jul 2023, 1:26:06 UTC

Users do not want their resources wasted by the server canceling tasks, especially if tasks are canceled while they are actively being worked on.
ID: 166 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Natalia Makarova
Volunteer moderator
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 14 Jun 23
Posts: 419
Credit: 280,293
RAC: 0
Message 170 - Posted: 27 Jul 2023, 2:05:18 UTC - in response to Message 166.  

Users do not want their resources wasted by the server canceling tasks, especially if tasks are canceled while they are actively being worked on.

Agree.

Therefore, I propose to stop the distribution of tasks and solve all problems.
ID: 170 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Conan

Send message
Joined: 16 Jun 23
Posts: 4
Credit: 1,407,674
RAC: 1,478
Message 171 - Posted: 27 Jul 2023, 2:34:23 UTC

G'Day ADSL@Home team,

With a quorum of 2 work units sent out in a project, it is usually done for the project to check that the results match and then credit is awarded to both volunteers.

If there is a quorum of 2 but you only need 1 result then there is no reason to send out 2 work units, just send 1.

Currently 2 are sent out but first one back gets the credit and the other is cancelled if it has not been started, or given the "Too late to validate" message if returned after the first work unit was returned.

It would be an easier thing to allow both work units to run check results and award credit. You already send out 2 work units you would only need to check results and then award the credit if both are correct.

Have a good day
Conan
ID: 171 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Demis
Project tester
Volunteer developer
Volunteer tester

Send message
Joined: 14 Jun 23
Posts: 259
Credit: 3,025,658
RAC: 20,228
Message 182 - Posted: 27 Jul 2023, 13:05:04 UTC - in response to Message 150.  
Last modified: 27 Jul 2023, 13:05:58 UTC

Problem fixed.

It will take some time until new tasks arrive.
ID: 182 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Demis
Project tester
Volunteer developer
Volunteer tester

Send message
Joined: 14 Jun 23
Posts: 259
Credit: 3,025,658
RAC: 20,228
Message 183 - Posted: 27 Jul 2023, 13:07:03 UTC - in response to Message 171.  

A very good tip.

Thank you!
ID: 183 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Demis
Project tester
Volunteer developer
Volunteer tester

Send message
Joined: 14 Jun 23
Posts: 259
Credit: 3,025,658
RAC: 20,228
Message 186 - Posted: 27 Jul 2023, 13:21:41 UTC - in response to Message 170.  

Users do not want their resources wasted by the server canceling tasks, especially if tasks are canceled while they are actively being worked on.

Agree.

Therefore, I propose to stop the distribution of tasks and solve all problems.

Now, more precisely, very soon, half of the duplicate tasks will be canceled.

From the moment this happens, those clients who have already received assignments may have questions.
Be ready...
ID: 186 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Henk Haneveld

Send message
Joined: 24 Jul 23
Posts: 2
Credit: 113,244
RAC: 0
Message 214 - Posted: 3 Aug 2023, 6:35:45 UTC

The work distribution and validation is still wrong.

There are still 2 copies send out and when 1 is returned it is validated but gets zero credit.
ID: 214 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Demis
Project tester
Volunteer developer
Volunteer tester

Send message
Joined: 14 Jun 23
Posts: 259
Credit: 3,025,658
RAC: 20,228
Message 216 - Posted: 3 Aug 2023, 8:25:42 UTC - in response to Message 214.  

The work distribution and validation is still wrong.

There are still 2 copies send out and when 1 is returned it is validated but gets zero credit.

I will cancel tasks.
ID: 216 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Natalia Makarova
Volunteer moderator
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 14 Jun 23
Posts: 419
Credit: 280,293
RAC: 0
Message 330 - Posted: 19 Aug 2023, 2:16:56 UTC

Workunits waiting for validation 2780

https://boinc.termit.me/adsl/server_status.php

Demis
Why are there so many tasks waiting for validation?

What is validation?
ID: 330 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ChelseaOilman

Send message
Joined: 26 Jul 23
Posts: 9
Credit: 10,124,696
RAC: 0
Message 333 - Posted: 19 Aug 2023, 13:40:59 UTC

Tasks getting validated doesn't seem to be happening for a day now. None of my tasks have been validated in the last day. My credit score is the same as yesterday. Currently I have Validation pending (2320) and it's increasing steadily. Also I have to manually update to keep my queue full as the client is currently showing long times between updates. Something is going wrong with the project. Please look into it.
ID: 333 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ChelseaOilman

Send message
Joined: 26 Jul 23
Posts: 9
Credit: 10,124,696
RAC: 0
Message 334 - Posted: 19 Aug 2023, 23:29:09 UTC

Now all I'm getting is validate errors. I'm aborting all remaining tasks. Not worth the effort.
ID: 334 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Natalia Makarova
Volunteer moderator
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 14 Jun 23
Posts: 419
Credit: 280,293
RAC: 0
Message 335 - Posted: 20 Aug 2023, 0:50:42 UTC

Workunits waiting for validation 10893

https://boinc.termit.me/adsl/server_status.php

Demis
What's happening??
ID: 335 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ChelseaOilman

Send message
Joined: 26 Jul 23
Posts: 9
Credit: 10,124,696
RAC: 0
Message 338 - Posted: 20 Aug 2023, 2:39:53 UTC
Last modified: 20 Aug 2023, 2:46:22 UTC

25% of those tasks are mine waiting to be validated. I'm not hopeful they will get credit. Validation pending (3262)
ID: 338 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · 4 . . . 6 · Next

Message boards : Number crunching : Problem with validation.

©2024 Natalia Makarova & Alex Belyshev & Tomáš Brada