Skip to main content
GullyHR

HR management consulting · Shipping companies

360-Degree Feedback and Rating Calibration for Shipping companies

Multi-rater feedback collects anonymous, behaviour-based views of a person from managers, peers, direct reports and sometimes customers. Rating calibration is a meeting where managers compare draft ratings and justify them with evidence before anything is shared. GullyHR designs both for startups and small and medium businesses: the questionnaire, rater rules, reports, distribution checks and the calibration agenda, with training for the people who run them.

A manager and employee having a constructive performance review with a shared notebook.

The operating context

Separate feedback themes from rating decisions

A shipping company runs vessels and the office that supports them. Seagoing crew, shore operations, technical and commercial staff live on different clocks, and certificates, rest hours and crew changes decide whether ships sail.

Masters, deck officers and engineersRatings and ship crewCrewing officersChartering and commercial executivesOperations and voyage staffTechnical superintendents
A fleet supervisor and HR coordinator reviewing a driver's records at a transport depot

The decision to work through

Define eligible raters, confidentiality rules, scoring anchors and the evidence managers bring to calibration. Workforce to consider: Masters, deck officers and engineers, Ratings and ship crew, Crewing officers.

Records to prepare

Rater selection rules, feedback themes and calibration notes. A workforce issue to consider: Long contracts and delays at relief time drive resignations.

An exception to test

Handle a very small rater group or conflicting scores without revealing individual respondents or averaging away the issue.

Which parts of your business should the scope cover?

The right workforce and approval structure depends on the operations you run. Confirm which of these apply, and whether they share one HR process.

  • Container shipping lines serving regional ports
  • NVOCC and consolidators selling LCL and FCL space
  • Ship agents handling port calls and husbandry
  • Coastal and feeder shipping operators
  • Bulk and break-bulk charterers moving commodities
  • Project cargo and out-of-gauge shipping specialists

When to consider this service

  • Ratings differ more by manager than by employee performance, and staff know it.
  • Almost everyone is rated good, so top performers see no difference in how they are treated.
  • A manager's own view is the only input, and it reflects the last two months.
  • Employees do not trust feedback surveys because they suspect that answers can be traced.

Businesses this service is designed for

  • Owners who suspect that ratings reflect the manager's habits more than the employee's work.
  • HR leads preparing the first calibration meeting in a growing company.
  • Teams with several managers and a single increment or promotion round.
  • Leaders who want an honest view of how their managers are seen by their teams.

Decisions this work supports

We begin by collecting draft ratings by manager and results data, such as target achievement, before ratings are shared. A distribution report shows averages, the share of top ratings, unchanged ratings from last year and gaps between ratings and results. In parallel we design the 360 exercise with the manager and employee: the rater circle, source weights, an anonymous form of eight to ten behaviours and two comment boxes, and a minimum number of responses before anything is reported. The calibration meeting follows, with the owner and managers presenting evidence for outliers and checking for halo, recency, similarity and inflation. Changes are recorded with reasons and signed off by a senior person. Debrief sessions turn 360 results into two or three development actions.

The 360 exercise is designed around behaviours that the business values.

We write eight to ten behaviour statements tied to your competencies, a one to five scale and two open comment questions, kept short enough to finish in minutes.

Rater circles and source weights are agreed before anyone is surveyed.

The manager and employee agree who sees the work. Weights are set by source, with the manager highest, so that no single group or friend circle dominates.

Anonymity rules protect honest answers from raters in small teams.

We set a minimum number of raters per source, remove comments that identify people or describe personality, and report averages by source, not by named person.

A distribution report exposes where ratings drift.

Averages, share of top ratings, central tendency, manager spread and comparison with results data show where ratings may be inflated, harsh or cautious.

The calibration meeting adjusts ratings with evidence, not seniority.

Each manager defends outliers with data. The agenda checks for halo, horn, recency, similarity and inflation motives, and every change is recorded with its reason.

Ongoing feedback habits keep the annual review from being a surprise.

Managers keep a simple feedback log, review it monthly for frequency, timing and quality, and practise corrective conversations through role-play coaching.

Diagnose, compare options and decide

Establish the management decision, constraints and evidence. Compare feasible options with the accountable leaders, including affordability, employee impact and implementation dependencies.

  1. 01

    Collect draft ratings

    Managers submit draft ratings and results data to HR before anything is discussed with employees. This gives a clean, unadjusted starting point.

  2. 02

    Produce the distribution report

    We compute averages, top-rating share, unchanged ratings and the gap between ratings and results, and flag managers whose pattern stands apart.

  3. 03

    Design and run the 360

    We agree the rater circle and weights, send the short anonymous questionnaire, collect responses and compile a report with scores by source and self against others.

  4. 04

    Brief the managers

    A short session explains the common rating errors with examples, and each manager prepares an evidence pack for any outlier rating.

  5. 05

    Hold the calibration meeting

    We facilitate a meeting with the owner and managers, work through outliers in turn, record each change and reason, and obtain a senior sign-off.

  6. 06

    Debrief and coach

    Managers receive 360 results privately, agree two or three development actions, and start a feedback log with a review on an agreed schedule and role-play coaching.

Record the chosen option, the decision owner and the measures to review. Revisit the framework when workforce needs or operating assumptions change.

Management frameworks and decision support

  • 360 questionnaire with eight to ten behaviour statements and two comment questions
  • Rater circle sheet and source weighting guide for each employee
  • Anonymised 360 report template showing self against others
  • Rating distribution and manager spread report with results comparison
  • Calibration meeting agenda, evidence pack form and decision log
  • Rating error checklist for managers with worked examples
  • Feedback log template and review sheet for each manager
  • Managers coached in debriefs and corrective feedback conversations

What your team provides

  • Chooses behaviours that match the company's values.
  • Encourages raters to respond and never asks who said what.
  • Managers bring evidence and the owner signs off final ratings.
  • Employees and managers agree and follow the actions.
  • Has its own qualified legal adviser check any decision with employment effects.

Share personal records only after the scope, access and handling arrangements are agreed.

Responsibilities and approvals

The client owns employee records and approves policies, spending and employment decisions. GullyHR's assigned responsibilities are documented in the engagement.

Designing the questionnaire and rater rules

GullyHR
Drafts statements, scales and anonymity thresholds.
Your team
Chooses behaviours that match the company's values.

Running the 360 survey and report

GullyHR
Sends forms, protects responses and compiles reports.
Your team
Encourages raters to respond and never asks who said what.

Facilitating the calibration meeting

GullyHR
Prepares the data and runs the agenda neutrally.
Your team
Managers bring evidence and the owner signs off final ratings.

Debriefs and development actions

GullyHR
Coaches managers and shapes the debrief format.
Your team
Employees and managers agree and follow the actions.

Link to pay, promotion or exit decisions

GullyHR
Notes where ratings feed into those decisions.
Your team
Has its own qualified legal adviser check any decision with employment effects.

Outputs to review at handover

Review these outputs with your process owner and agree the evidence required for sign-off.

  • 360 questionnaire with eight to ten behaviour statements and two comment questions
  • Rater circle sheet and source weighting guide for each employee
  • Anonymised 360 report template showing self against others
  • Rating distribution and manager spread report with results comparison
  • Calibration meeting agenda, evidence pack form and decision log
  • Rating error checklist for managers with worked examples
  • Feedback log template and review sheet for each manager
  • Managers coached in debriefs and corrective feedback conversations

Tools and implementation dependencies

Questionnaires can run on a form tool you already use, and responses are kept in a restricted folder that only the project team can open. The distribution report, calibration log and feedback log are editable sheets. The GullyHR software can collect ratings and 360 responses too, but it is optional. Response data is shared only in summary form.

Read the full 360-degree feedback and rating calibration service guide →

Agree the engagement before work starts.

360 pilot for managers

A short anonymous exercise for a defined group of managers, with reports, debriefs and development actions. A good way to test the approach.

Calibration cycle support

A distribution report, manager briefing and facilitated meeting during one rating round. Suits a company about to finalise ratings and increments.

Full feedback and rating system

Questionnaire design, rater rules, 360 runs, calibration, feedback logs and manager coaching through a complete cycle.

Alongside performance management

We build 360 and calibration inside your wider performance process, linked to goals, competencies and manager development, so the parts work together.

Scope and exclusions

  • Management retains employment, organisation and spending decisions. The engagement supports those decisions; it does not automatically include daily HR administration or monthly payroll processing.
  • You have no rating scale or appraisal cycle yet; calibration needs ratings to compare.
  • You want a single manager coached rather than a cross-manager process.
  • You want 360 results to decide pay directly; we advise using them for development and will say so.
  • Your immediate need is a software tool to collect ratings, not the method behind it.
Confidentiality, specialist review and accountability

Limit access to the records needed for the agreed work. Confirm authorised users, secure sharing, retention and return or deletion arrangements before exchanging personal information.

Applicability depends on locations, workforce arrangements and the issue under review. Confirm applicable requirements with your qualified adviser before adopting policies or employment actions; this service is not a legal certification.

Employment-law opinions, statutory filings, professional or clinical standards and safety-critical technical decisions require the appropriate qualified professional; include those dependencies in the scope.

Questions before you decide

For shipping companies, identify who owns these records: rater selection rules, feedback themes and calibration notes. Start with an anonymised example and the decision you need to make; agree the sample and access before sharing personal data.

Discuss your priorities

Tell us the teams and locations involved, what is happening today and what you want this work to resolve.

Start with your business need

What does your HR team need to solve?

Tell us your industry, team size and the issue you want to address. Bring one example of where work gets delayed or ownership is unclear, and the deadline or decision you are working towards.

  • A free first conversation with an HR practitioner
  • A clear scope and fee before any paid work
  • A practical next step for your business

Let’s start with your business

Share your contact details and the HR challenge on your mind. We’ll help you find the right starting point.

Include your country code, for example +44 or +1. Indian numbers can be 10 digits.

Your details stay private. Privacy policy