Skip to content

Reference guide · Great circle, sight reduction and passage planning

Great circle sailing calculator: vertex, waypoints and saving

By the Mirage Interactive team · Last checked

The shortest path between two places on a sphere is the great circle. On a chart that uses the Mercator projection it looks like a curve that bows toward the nearer pole, and the further apart the places are in longitude, the more it bows.

This guide takes two views. First, the clean case of two places on the same latitude, which shows how much distance a great circle saves and where its highest latitude, the vertex, falls. Second, a published course from the American Practical Navigator (Bowditch) worked out waypoint by waypoint.

The short answer

Central angle c from cos c = sin(lat1) x sin(lat2) + cos(lat1) x cos(lat2) x cos(difference of longitude). Distance in nautical miles = c in degrees x 60.

Two places at 40 degrees north, 60 degrees of longitude apart, are 2,703 nautical miles apart on the great circle and 2,758 along the parallel: the great circle saves 55 nautical miles and reaches 44.1 degrees north.

Tables

The first table covers two places on one latitude (north or south alike), by latitude and difference of longitude: the great circle distance, the distance along the parallel, the saving and the vertex latitude. The second gives the position after each 300 nautical miles on the great circle that leaves 38 degrees north, 125 degrees west on initial course 291. Use your browser's print command to print this page: the tables print without the navigation.

Between two points on one parallel the great circle bows toward the pole, so it is shorter than sailing along the parallel. The vertex is its highest latitude.
Great circle against sailing along the parallel for two places on one latitude (nautical miles; vertex latitude in degrees)
Latitude (deg)Difference of longitude (deg)Great circle (nm)Along the parallel (nm)Saving (nm)Vertex latitude (deg)
30301,5541,559530.9
30603,0793,1183933.7
30904,5314,67714539.2
301205,8316,23540549.1
40301,3721,379741.0
40602,7032,7585544.1
40903,9364,13720149.9
401204,9875,51652859.2
50301,1491,157851.0
50602,2502,3146454.0
50903,2443,47122759.3
501204,0594,62856967.2
6030892900860.9
60601,7371,8006363.4
60902,4852,70021567.8
601203,0793,60052173.9

Source: computed by the site build from the formulas below.

Waypoints on the great circle from 38 N, 125 W on initial course 291 degrees true (positions in degrees, west negative)
Distance run (nm)Latitude (deg N)Longitude (deg)
30039.6-131.1
60040.9-137.4
90041.9-143.9
120042.5-150.6
150042.6-157.4

Source: computed by the site build from the formulas below.

Formulas

Distance
cos c = sin(lat1) sin(lat2) + cos(lat1) cos(lat2) cos(dLong) distance (nm) = c (degrees) x 60
One nautical mile is one minute of arc of a great circle on the sphere the calculation uses.
Initial course
tan(C) = sin(dLong) cos(lat2) / (cos(lat1) sin(lat2) - sin(lat1) cos(lat2) cos(dLong))
Measured clockwise from true north; choose the quadrant from the signs of the two terms. The course changes along the way, so this is the course at the start.
Vertex
cos(vertex latitude) = cos(lat1) x sin(C) cos(dLong to vertex) = tan(lat1) / tan(vertex latitude)
The vertex is the point of highest latitude on the great circle. It lies on the track only when the track passes it.
Position after a distance
sin(lat2) = sin(lat1) cos(c) + cos(lat1) sin(c) cos(C)
With c the central angle of the distance run (nm / 60 in degrees). The longitude follows from the same quantities.
Two places on one latitude
cos c = sin^2(lat) + cos^2(lat) cos(dLong) vertex: tan(vertex) = tan(lat) / cos(dLong / 2) along the parallel = dLong x 60 x cos(lat)
The vertex is half way in longitude. The last expression is parallel sailing: departure equals the difference of longitude in minutes times the cosine of the latitude.

Worked example

The vertex of a published course, and a passage across the Pacific

  1. From 38 N, 125 W on initial course 291: cos(vertex latitude) = cos 38 x sin 291 = 0.7880 x 0.9336, so the vertex is at 42.636 N (42 degrees 38.2 minutes; Bowditch prints 42 degrees 38.1 minutes).
  2. The distance to the vertex is 1478.4 nautical miles (cos d = sin 38 / sin 42.636), and the change of longitude to it is 31.9 degrees. Bowditch reads 32.4 degrees and 1,500 nautical miles from a five degree grid and calls both approximate.
  3. After 300 nautical miles on that course the position is 39.6 N, 131.1 W; after 600 it is 40.9 N, 137.4 W; after 900, 41.9 N, 143.9 W. Those three agree with the table printed in Bowditch to 0.1 degree.
  4. A longer passage: from 38 N, 122 W to 24 S, 151 E the great circle is 6,137 nautical miles on an initial course of 249.0 degrees true (Bowditch: 6,137 nautical miles, course 249.0).
  5. To steer it, pick waypoints along the great circle at intervals you can sail, such as every 300 nautical miles, and sail each leg as a rhumb line, which is a constant compass course.

Things to watch

  • This is a planning calculation on a sphere. It ignores the Earth's flattening, which changes distances by a fraction of one percent, and it knows nothing of land, ice, weather or traffic along the track.
  • The vertex is the highest latitude on the full great circle. If your track ends before reaching it, the vertex is not on your route.
  • The saving grows with latitude and with the difference of longitude, and it is small for short passages. At low latitude, or over a short distance, the two paths are almost the same.
  • A planning and training aid, not for primary navigation. Verify with official charts and publications.

Related guide: Great circle and rhumb line distance: formulas and worked passages

More from this family: CPA and TCPA calculator: closest point of approach and time to it · Sight reduction worked example: Hc, Zn and intercept step by step · Nautical miles calculator: distance, conversion and passage time

Skip the arithmetic

Nautical Navigation Calculator

Nautical Navigation Calculator gives the distance, courses and vertex of a great circle, and Mercator sailing for a rhumb line, with every step shown. It has no chart and does not say that a course is safe: a planning and training aid. One-time purchase · No subscription · Price shown in your store. Works offline, no ads, no account.

Questions

How do you calculate a great circle distance?

Find the central angle from the cosine formula, convert it to degrees and multiply by 60 for nautical miles.

What is the vertex of a great circle?

The point on the great circle that is nearest to a pole, where the track runs due east or west.

Is a great circle always shorter than a rhumb line?

It is never longer. On a north-south course, or along the equator, the two are the same.