Patent Issued for Detailed damage determination with image segmentation (USPTO 11257204): Tractable Ltd.

2022 MAR 15 (NewsRx) -- By a News Reporter-Staff News Editor at Insurance Daily News -- From Alexandria, Virginia, NewsRx journalists report that a patent by the inventors Aktas, Rusen (London, GB), Ayel, Mathieu (London, GB), Chatfield, Ken (London, GB), Decamp, Laurent (London, GB), Horstmann, Marcel (London, GB), Kirschner, Franziska (London, GB), Mattsson, Bjorn (London, GB), Oellrich, Janto (London, GB), Peyre, Julia (London, GB), Ranca, Razvan (London, GB), Teh, Yih Kai (London, GB), Trill, Shaun (London, GB), Van Oosterom, Crystal (London, GB), filed on May 20, 2021, was published online on February 22, 2022.

The patent’s assignee for patent number 11257204 is Tractable Ltd. (London, United Kingdom).

News editors obtained the following quote from the background information supplied by the inventors: “Typically, and as shown in FIG. 1, when a vehicle is involved in an accident (or is damaged) 105, the vehicle or its driver will be insured, and the driver will contact the relevant insurance company 110 to make a claim following a typical claim procedure 100.

“The insurance company’s estimation team 135 will then need to assess the damage to the vehicle and approve any claim, and the driver or insurer will then arrange for the vehicle to be repaired 145. Alternatively, the insurance company may make a cash settlement 150 in place of arranging or paying for repairs or may make a decision that the vehicle is a total loss 140 and compensate the insured party accordingly or arrange for a replacement vehicle to be procured.

“As shown in FIG. 1, the claim procedure 100 following an accident 105 requires the driver or insured party to call their insurer 110, and personnel at the insurer will follow a script 115 to receive and process the claim.

“As part of the script 115, the insurer will obtain from the driver or insured party some information about the accident 105. Typically, the insurer will be provided with information about the insured person 120 (which may also include details of the vehicle and its condition etc that are provided during the call, or which are stored in the insurer’s database and retrieved following receipt of the details of the insured person); details of the crash or accident 125, for example the circumstances and extent of the damage; and photos of the damage 130.

“The photos of the damage 130 are typically taken by the driver or the insured party and can be of varying quality and comprehensiveness. Typically, photos are taken using phones equipped with cameras. Various problems can arise from this approach, including that too few photos are taken and provided to the insurer. Also, the photos taken may not be sufficiently well composed or may be of low quality due to the quality of the camera used to take the photos or the skill of the user.

“The photos of the damage 130 can be provided to the insurer either via e-mail, facsimile or post, for example. This means there is typically a delay in the receipt of the photos 130 by the insurer, thus delaying the processing of the claim by the insurer and slowing down the decision-making process as to whether the damage is a total loss 140, or whether a cash settlement 150 can be offered, or whether to arrange or allow the driver or insured part to arrange for repairs to the vehicle 145.

“As part of the claim procedure, and more specifically the claim review procedure which is carried out by the insurer to verify the costs of the proposed repair work by manually assessing data provided by the client and any proposed repairer, the insurer may request further information or claim data to be provided from the driver or insured party regarding the accident. This may include details of the vehicle and its condition prior to any damage etc. These are typically provided during a telephone call or are obtained having been stored in the insurer’s database, but sometimes requires the insurer to contact the insured party in a follow up telephone call, letter or e-mail requesting the further details. Further, the insurer will require sufficient details of the accident to be provided, along with sufficient photographs of the damage for example, so this must be obtained during the first and any subsequent contact with the insured party. The process of obtaining sufficient information can be slow, especially if further requests for information are made in separate subsequent contacts with the insured party, and thus can significantly delay the processing of an insurance claim. Further, the proposed repairer may be required to send details of the proposed repairs, including for example the labour tasks as well as any parts or materials costs, to the insurer for approval prior to commencing work. The insurer can then assess whether the claim is covered by the relevant policy under which the claim is made and determine whether the estimated costs of repair can be verified and/or approved as may be appropriate.

“Various tools and processes have been developed to assist vehicle repair businesses and vehicle insurers respectively to prepare and approve repair proposals for damaged vehicles, for example as a result of the vehicle being involved in an accident.

“Vehicle repair businesses need to be able to itemise both the labour required and the specific parts required in order to repair the vehicle, and then submit this for approval to an insurer where the repair is covered by an insurance policy. Due to the large number of different possible makes and models that might require repair, and the optional extras that might have been fitted to the vehicle to be repaired, vehicle repair businesses typically have to use a commercial database to identify the correct make, model, year of manufacture and options fitted in order to correctly identify the parts that would need to be ordered if any need replacement.

“Insurers typically require vehicle repair businesses to submit evidence of the damage to each vehicle and a detailed repair proposal that itemises the parts to be ordered and the respective costs of each part along with detailed itemisation of the labour tasks and time that will be required to carry out any repairs or replacement of parts. Preparing such detailed repair proposals manually typically takes vehicle repair businesses a significant amount of time.

“In different jurisdictions, different approaches are taken by both vehicle repair businesses (in respect of how repairs are carried out, what labour is deemed to be required, and preferences as to whether to repair or replace parts, for example) and insurers (in respect of what policies are applied when approving or rejecting proposed repairs, for example), depending on a variety of factors such as commercial pressures, regulation, consumer preference and typical insurance coverage. Thus, detailed repair proposals will differ between jurisdictions and what insurers are prepared to approve in a detailed repair proposal will also differ between jurisdictions.

“Insurers, however, typically perform manual reviews on proposed repairs that are submitted for approval by vehicle repair businesses. As a result, the manual review process either requires a large workforce to perform the task of reviewing each submitted repair proposal or becomes a bottleneck in the repair approval process. For vehicle repair businesses, manual review can result in several disadvantages including delay in being able to begin repair work; further delays if the repair proposal is rejected by the insurer; and having to store customer vehicles for longer periods than necessary resulting in both higher storage space requirements and a higher probability of dissatisfied customers.

“Across all jurisdictions, a variety of the above-described problems can result from manual preparation of proposed vehicle repairs and manual review of the proposed vehicle repairs by insurers.

“Improvements to the claim procedure would enable repairs to be completed sooner and for insurers to reach decisions faster and more efficiently.”

As a supplement to the background information on this patent, NewsRx correspondents also obtained the inventors’ summary information for this patent: “Aspects and/or embodiments seek to provide a computer-implemented method for determining damage states of each part of a damaged vehicle, indicating whether each part of the vehicle is damaged or undamaged and optionally the severity of the damage to each part of the damaged vehicle, using images of the damage to the vehicle and trained models to assess the damage indicated in the images of the damaged vehicle, including performing segmentation of the images to create richer input data.

“According to a first aspect, there is provided a computer-implemented method for determining one or more damage states to one or more parts of a vehicle, comprising the steps of: receiving one or more images of the vehicle; determining, per part, one or more segmentations of each of the one or more images of the vehicle using one or more trained segmentation models; determining one or more damage states of each of the parts of the vehicle based on one or more classifications, per part, for each of the one or more images of the vehicle and the one or more segmentations; and outputting the one or more damage states of each of the parts of the vehicle.

“Segmenting as part of determining the damage states of a plurality of parts of a vehicle from images of the damaged vehicle can allow for richer data to be generated with which to determine damage states of the parts of the vehicle.

“Optionally, the one or more segmentations of each of the one or more images of the vehicle comprises one or more areas of damage to the vehicle and/or one or more areas of interest on the vehicle.

“Providing either areas of damage and/or areas of interest when performing segmentation and/or generating segmentation data for images can provide richer data to increase the effectiveness and/or accuracy of using determining damage states of parts of a vehicle using images of the damage to the vehicle.”

The claims supplied by the inventors are:

“1. A computer-implemented method for determining one or more damage states to one or more parts of a vehicle, comprising: receiving one or more images of the vehicle; determining, per part, one or more segmentations of each of the one or more images of the vehicle using one or more trained segmentation models; determining one or more damage states of each of the parts of the vehicle based on one or more classifications, per part, using a convolutional neural network configured with each of the one or more images of the vehicle and the one or more segmentations; and outputting the one or more damage states of each of the parts of the vehicle.

“2. The computer-implemented method of claim 1, wherein the one or more segmentations of each of the one or more images of the vehicle comprises one or more areas of damage on the vehicle and/or one or more areas of interest on the vehicle.

“3. The computer-implemented method of claim 1, wherein determining one or more damage states of each parts of the vehicle comprises a comparison between the one or more classifications and the one or more segmentations.

“4. The computer-implemented method of claim 1, further comprising determining a plurality of parts of the vehicle that are represented in the plurality of images of the vehicle comprising the use of a plurality of classifiers.

“5. The computer-implemented method of claim 4, wherein each one of the plurality of classifiers is operable to detect each of the parts of the vehicle, optionally wherein each one of the plurality of classifiers is further operable to determine a damage classification.

“6. The computer-implemented method of claim 4, wherein said parts of the vehicle comprise any or any combination of: normalized parts of the vehicle; normalized regions of the vehicle; normalized zones of the vehicle; standardized parts of the vehicle; standardized regions of the vehicle; standardized zones of the vehicle.

“7. The computer-implemented method of claim 1, wherein the damage states of parts of the vehicle are determined as one or more quantitative values.

“8. The computer-implemented method of claim 1, wherein the image resolution of each of the received plurality of images is substantially maintained.

“9. The computer-implemented method of claim 1, further comprising: cropping each of the plurality of images into a plurality of cropped images; and wherein the determining one or more feature representations comprises determining, per part, one or more feature representations for each of the plurality of cropped images using a first trained model, wherein each feature representation comprises an indication of damage to at least one part.

“10. The computer-implemented method of claim 1, wherein the one or more trained segmentation models comprises any one or any combination of: a neural network; a convolutional neural network; and/or a recurrent neural network.”

For additional information on this patent, see: Aktas, Rusen. Detailed damage determination with image segmentation. U.S. Patent Number 11257204, filed May 20, 2021, and published online on February 22, 2022. Patent URL: http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO1&Sect2=HITOFF&d=PALL&p=1&u=%2Fnetahtml%2FPTO%2Fsrchnum.htm&r=1&f=G&l=50&s1=11257204.PN.&OS=PN/11257204RS=PN/11257204

(Our reports deliver fact-based news of research and discoveries from around the world.)