PWA Queue's failing and blocking correlation

T

TheWall

Hi, im trying to find out why lots of my Queue's are failing.

Get the following msg's in Application Log:

Event Type: Error
Event Source: Office SharePoint Server
Event Category: Project Server Queue
Event ID: 7704
Date: 2009/01/19
Time: 12:50:58 PM
User: N/A
Computer: Server1
Description:
Standard Information:pSI Entry Point:
Project User: Domain\User
Correlation Id: edb1d5c9-9911-4241-a1a0-e9383e842715
PWA Site URL: http://intranet/PWA
SSP Name: SharedServices1
PSError: GeneralQueueJobFailed (26000)
A queue job has failed. This is a general error logged by the Project Server
Queue everytime a job fails - for effective troubleshooting use this error
message with other more specific error messages (if any), the Operations
guide (which documents more details about queued jobs) and the trace log
(which could provide more detailed context). More information about the
failed job follows. GUID of the failed job:
d06b0dbf-1d6a-45e1-9e90-9d1326fcbbaf. Name of the computer that processed
this job:Server1 (to debug further, you need to look at the trace log from
this computer). Failed job type: TimesheetUpdate. Failed sub-job type:
UpdateTimesheetExceptionsMessage. Failed sub-job ID: 1. Stage where sub-job
failed: (this is useful when one sub-job has more than one logical
processing stages).

Under the Queue's i get the following error:
Error summary/areas:
Array
CICOAlreadyCheckedOutToYou
Queue
GeneralQueueJobFailed
Error details:

<?xml version="1.0" encoding="utf-16"?>
<errinfo>
<array name="Array" type="System.Guid">
<item value="36116f8c-b4e6-4df3-ae9e-dfaaa0815bab">
<error id="10101" name="CICOAlreadyCheckedOutToYou"
uid="31883135-c316-4bc0-8746-f4193f04ce2b" />
</item>
</array>
<general>
<class name="Queue">
<error id="26000" name="GeneralQueueJobFailed"
uid="4429ce22-31da-4db8-b599-490bba24cbe1"
JobUID="d06b0dbf-1d6a-45e1-9e90-9d1326fcbbaf" ComputerName="Server1"
GroupType="TimesheetUpdate" MessageType="UpdateTimesheetExceptionsMessage"
MessageId="1" Stage="" />
</class>
</general>
</errinfo>

Any ideas where to start looking?
 
T

TheWall

I also just found out the the Status on Timesheers between PWA and Cube's are
not the same?

Think this might be related...
 
T

TheWall

Where do i get the following:

for effective troubleshooting use this error message with other more
specific error messages (if any), the Operations guide (which documents more
details about queued jobs) and the trace log (which could provide more
detailed context).
 
T

TheWall

Ok, getting this on here step by step but everytime i look i see another
piece of the puzzle:


Event Type: Error
Event Source: Office SharePoint Server
Event Category: Project Server Timesheet
Event ID: 7850
Date: 2009/01/20
Time: 09:08:45 AM
User: N/A
Computer: Server1
Description:
Standard Information:pSI Entry Point:
Project User: Domain\Username
Correlation Id: 59d13619-10f5-45ab-a3d6-6e45bf947daf
PWA Site URL: http://inet/PWA
SSP Name: SharedServices1
PSError: TimesheetIncorrectMode (3204)
An incorrect state change request has been made. Project Server could not
process your request. The existing state of the Timesheet is: (please refer
to the documentation for what the Timesheet state number means)
 
T

TheWall

Not much Project Expertise it seems...

Some more info:
The Moss and Prject server is a virtual machine running win 2003 and the SQL
server is a Physical machine running SQL 2005 Ent edition
 
G

Gary L. Chefetz

The wall:

You have two different problems going on. Let's focus on the first case,
which indicates that you're trying to save and or publish a project "CICO"
that the system believes is already checked out to you in another session.
This might indicated that you have some queue jobs stuck in the getting
enqueued state.If you have not already installed both SP1 and the
Infrastructure Update or later, then in the queue management page, it is
very important that you expand the Advanced section and select the checkbox
to "cancel jobs getting enqueued." Make sure that you cancel all jobs stuck
in this state and see if that moves things along.

--
----------
Gary L. Chefetz, MVP
MSProjectExperts
Project Server Consulting: http://www.msprojectexperts.com
Project Server Training: http://www.projectservertraining.com
Project Server FAQS: http://www.projectserverexperts.com
Project Server Help Blog: http://www.projectserverhelp.com
 
T

TheWall

Hi,

Ok, i checked the cancel Button and took the date back a year and clicked on
refresh... i assume that canceled everything if i missed it and then i went
back and un checked the "Cancel jobs getting enqueued" Button.

I have got SP1 installed. Not sure what Infrastructure Update you are
talking about.
The only Hotfix installed:
KB950816

Thanks
 
T

TheWall

mmm, im not sure where to find that download, the only downloads under MSDN
is SP1.

Assuming it is this download:
Project Server 2007 – KB960313

Should i install this one aswell:
Office SharePoint Server 2007 – KB959637

Thanks



CICO file? Sorry, not to fimiluar with project.
 
M

Michael Brown

Gary,

I think that "CICO" refers to "Check-in, Check-out" - i've seen that one
before too :) Usually you run into a CICO error when you're trying to check
back in a project that's already checked in - it's a timing issue in the
queues.
 
T

TheWall

Hi Gary,

In connection with CICO, i did cancel all the jobs but i still get some that
say failed and blacking correlation.

I am busy downloading the hotfix and will install it over the cource of the
weekend

Thanks
 
T

TheWall

Hi, im not sure about eventhandlers, i will try and find out.

I saw some more errors:

The backup completes with errors and the following errors i found. I have
downloaded the CUpadate but the backup does not complete successfully so a
bit wary to run the update with backups failing.


In app log:

Event Type: Error
Event Source: Office SharePoint Server
Event Category: Office Server Shared Services
Event ID: 6482
Date: 2009/01/25
Time: 06:01:07 PM
User: N/A
Computer: Server1
Description:
Application Server Administration job failed for service instance
Microsoft.Office.Server.Search.Administration.SearchServiceInstance
(1480cfc9-c77e-4063-9d48-c952957b7026).

Reason: Object 7a8d48ae-9509-470e-a263-b67152aa1a34 not found.

Techinal Support Details:
System.Collections.Generic.KeyNotFoundException: Object
7a8d48ae-9509-470e-a263-b67152aa1a34 not found.
at Microsoft.Office.Server.Search.Administration.SearchApi.get_App()
at
Microsoft.Office.Server.Search.Administration.SearchApi.SetUsersPermittedToQuery(String[] userNames, Boolean force)
at
Microsoft.Office.Server.Search.Administration.SearchServiceInstance.Synchronize()
at
Microsoft.Office.Server.Administration.ApplicationServerJob.ProvisionLocalSharedServiceInstances(Boolean isAdministrationServiceJob)

In backup log:

Error: Object Shared Search Index failed in event OnBackupComplete. For more
information, see the error log located in the backup directory.
Object Shared Search Index failed in event OnPrepareBackup. For more
information, see the error log located in the backup directory.
UpdatedConcurrencyException: The program attempted to update an object that
was updated by another user.
UpdatedConcurrencyException: The program attempted to update an object that
was updated by another user.

In Older backup log:



[1/24/2009 5:22:10 AM]: Error: Object Shared Search Index failed in event
OnPrepareBackup. For more information, see the error log located in the
backup directory.

KeyNotFoundException: Object
7a8d48ae-9509-470e-a263-b67152aa1a34 not found.

[1/24/2009 5:22:10 AM]: Debug: at
Microsoft.Office.Server.Search.Administration.SearchApi.get_App()

at Microsoft.Office.Server.Search.Administration.SearchApi.get_Project()

at
Microsoft.Office.Server.Search.Administration.SearchApi.CatalogResumeCrawlInternal(Int32 reason)

at
Microsoft.Office.Server.Search.Administration.SearchApi.<>c__DisplayClass104.<CatalogResumeCrawlRequest>b__103()

at
Microsoft.Office.Server.Search.Administration.SearchApi.RunVoidOnServer(VoidCodeToRun
remoteCode, VoidCodeToRun localCode, Boolean useCurrentSecurityContext, Int32
versionIn)

[1/24/2009 5:22:10 AM]: Verbose: Starting object: SharedServices9_Search_DB.
 
T

TheWall

It looks like that hotfix might have fixed it. (KB960011)

Will give it some time but looks good

TheWall said:
Hi, im not sure about eventhandlers, i will try and find out.

I saw some more errors:

The backup completes with errors and the following errors i found. I have
downloaded the CUpadate but the backup does not complete successfully so a
bit wary to run the update with backups failing.


In app log:

Event Type: Error
Event Source: Office SharePoint Server
Event Category: Office Server Shared Services
Event ID: 6482
Date: 2009/01/25
Time: 06:01:07 PM
User: N/A
Computer: Server1
Description:
Application Server Administration job failed for service instance
Microsoft.Office.Server.Search.Administration.SearchServiceInstance
(1480cfc9-c77e-4063-9d48-c952957b7026).

Reason: Object 7a8d48ae-9509-470e-a263-b67152aa1a34 not found.

Techinal Support Details:
System.Collections.Generic.KeyNotFoundException: Object
7a8d48ae-9509-470e-a263-b67152aa1a34 not found.
at Microsoft.Office.Server.Search.Administration.SearchApi.get_App()
at
Microsoft.Office.Server.Search.Administration.SearchApi.SetUsersPermittedToQuery(String[] userNames, Boolean force)
at
Microsoft.Office.Server.Search.Administration.SearchServiceInstance.Synchronize()
at
Microsoft.Office.Server.Administration.ApplicationServerJob.ProvisionLocalSharedServiceInstances(Boolean isAdministrationServiceJob)

In backup log:

Error: Object Shared Search Index failed in event OnBackupComplete. For more
information, see the error log located in the backup directory.
Object Shared Search Index failed in event OnPrepareBackup. For more
information, see the error log located in the backup directory.
UpdatedConcurrencyException: The program attempted to update an object that
was updated by another user.
UpdatedConcurrencyException: The program attempted to update an object that
was updated by another user.

In Older backup log:



[1/24/2009 5:22:10 AM]: Error: Object Shared Search Index failed in event
OnPrepareBackup. For more information, see the error log located in the
backup directory.

KeyNotFoundException: Object
7a8d48ae-9509-470e-a263-b67152aa1a34 not found.

[1/24/2009 5:22:10 AM]: Debug: at
Microsoft.Office.Server.Search.Administration.SearchApi.get_App()

at Microsoft.Office.Server.Search.Administration.SearchApi.get_Project()

at
Microsoft.Office.Server.Search.Administration.SearchApi.CatalogResumeCrawlInternal(Int32 reason)

at
Microsoft.Office.Server.Search.Administration.SearchApi.<>c__DisplayClass104.<CatalogResumeCrawlRequest>b__103()

at
Microsoft.Office.Server.Search.Administration.SearchApi.RunVoidOnServer(VoidCodeToRun
remoteCode, VoidCodeToRun localCode, Boolean useCurrentSecurityContext, Int32
versionIn)

[1/24/2009 5:22:10 AM]: Verbose: Starting object: SharedServices9_Search_DB.




Sean Hanson said:
Are you using any event handlers to update custom fields?
--
Sean Hanson

http://www.randsmanagement.com
Mass Resource Tool for 2007
Project Server 2007 Archive Tool
2007 ULS Log Reporting
SRS Report Packs
Click to expand...
Click to expand...
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Similar Threads

Failed and Blocking Correlation [2007] 1
Job Queue Failure 2
My queued jobs-PWA: Failed but not blocking correlation. Timesheet 2
Errors in queue jobs 0
Not able to delete jobs from the Manange Queue page 1
Proposal not converting to a Project 2
how to resovle MS project 2007 - CICONotCheckedOut - Failed But No 1
UpdateWSSCountersMessage-What is this error? 0

Top