Body
Applications Recovery Procedures for VS02 Outage
Background
CRMVS02 contains several key servers which are critical to Walbec business operations. These include, but are not limited to:
Apex (SQL and APP)
CRMSQL1 – Has to do with Daily Job Reports, Report Server
CRMSQL2 – Has to Do with Daily Job Reports, Report Server, Lastrada
CRMSQL4 – Has to do with Kofax (E-mail invoices to CMIC automation)
E360 (SQL, APP, and TASKS)
HBSQL (HeavyBid)
HCSSFS (HCSS File Server)
HCSSTasks
HCSS Terminal Servers 6-10
HJSQL (HeavyJob)
RPTSVR (Report Server)
Recovery
If CRMVS02 goes down almost all of the systems will naturally recover. To be sure, it’s important to go through the servers individually to check as well as follow the below special instructions for specific applications. Essentially, most of the instructions are identical to logons we must perform for server checks.
Log Back on to Servers
We need to do this to allow certain services/network mappings to work.
HCSSTASKS
- Launch the Remote Desktop Connection item
- Select or type in HCSSTASKS in the Computer drop list field
- Click the Connect button
- Log in with the hcsstasksadmin account.
- (If it appears) On the Important Notice! window, click OK
- Close the Remote Desktop Connection window; do not logout
- On the "Your remote session will be disconnected" message, click the OK button
E360TASKS
- Launch the Remote Desktop Connection item
- Select or type in e360tasks in the Computer drop list field
- Click the Connect button
- Log in with the e360tasksadmin account.
- (If it appears) On the Important Notice! window, click OK
- Close the Remote Desktop Connection window; do not logout
- On the "Your remote session will be disconnected" message, click the OK button
HBSQL
- Launch the Remote Desktop Connection item
- Select or type in hbsql in the Computer drop list field
- Click the Connect button
- Log in with the hbsqladmin account.
- (If it appears) On the Important Notice! window, click OK
- Close the Remote Desktop Connection window; do not logout
- On the "Your remote session will be disconnected" message, click the OK button
Special Case: HeavyJob Timecards
Restarting Boomi Listeners
- In Boomi, go to Runtime Management
- Select “boomiatom.crmanagement.com”
- Click “Listeners”
- Click “Restart” then “All Listeners”
- Repeat for boomiatomtest.crmanagement.com (and dev if needed)
Re-initializing HJ Timecard Import
After restarting the Boomi listeners,
- Navigate to \\hcssfs\hcss\production\heavyjob\ExportPayroll
- Under each business unit folder, check for existing file called “CrewTimeHeader.csv”
- Rename the file (can be as simple as “CrewTimeHeaderX.csv”
- Rename the file back to “CrewTimeHeader.csv”
- Repeat for each business unit folder.