error in api

[bhanuash7]

model is behaving will while at is loaded to webui but it is behaving odd when its called by api

{
"role": "user",
"content": "Tell me more about the Best of Goa with Dudhsagar Falls package."
},
{
"role": "assistant",
"content": "Action: \nAction Input:"
},

getting empty or funtion is not been called why?

[bhanuash7]

python3 src/api.py --model_name_or_path mistralai/Mistral-7B-Instruct-v0.3 --adapter_name_or_path saves/Mistral-7B-v0.3-Chat/lora/july8 --template mistral --finetuning_type lora --quantization_bit
4

[bhanuash7]

{
"model": "convo",
"messages": [
{
"role": "user",
"content": "hi"
},
{
"role": "assistant",
"content": "Hello! How can I assist you today?"
},
{
"role": "user",
"content": "give me goa packages"
},
{
"role": "function",
"content": "{"name": "searchPackages", "arguments": "{\"searchText\": \"Goa\", \"listToDisplay\": true}"}"
},
{
"role": "tool",
"content": "Here's the list of packages available with thomas cook, A Week in Goa-8 days-Price:26249, The Zuri White Sands Goa Resort And Casino-4 days-Price:0, Exotic Goa-6 days-Price:19149, Best of Goa with Dudhsagar Falls-7 days-Price:24449"
},
{
"role": "assistant",
"content": "Here's the list of packages available with thomas cook, A Week in Goa-8 days days-Price:Price:26249, The Zuri White Sands Goa Resort And Casino-4 days days-Price:Price:0, Exotic Goa-6 days days-Price:Price:19149, Best of Goa with Dudhsagar Falls-7 days days-Price:Price:24449"
},
{
"role": "user",
"content": "Tell me more about the Exotic Goa package."
},
{
"role": "function",
"content": "{"searchText": "Exotic Goa", "numberOfDays": 6, "budget": 19149, "listToDisplay": false}"
},
{
"role": "tool",
"content": "Package ID: PKG010956 is named 'Exotic Goa' and spans 6 days. The itinerary includes:\nDay 1 - Goa, Meals: N/A, Description: \nArrival Goa\n \nUpon arrival at airport meet our representative & get transferred to your Hotel. Check into the hotel. The rest of the day is at leisure., GeoLocation: (Lat: 15.299326, Lon: 74.123996).\nDay 2 - Goa, Meals: Breakfast, Description: \nGoa\n \nToday after breakfast proceed for sightseeing of North Goa covering - Fort Aguada, Candolim Beach, Calangute Beach, Baga Beach, Anjuna.\n \nOptional Dolphin Trip & Water Sports at additional cost on direct payment basis., GeoLocation: (Lat: 15.299326, Lon: 74.123996).\nDay 3 - Goa, Meals: Breakfast, Description: \nGoa\n \nDay is at Leisure., GeoLocation: (Lat: 15.299326, Lon: 74.123996).\nDay 4 - Goa, Meals: Breakfast, Description: \nGoa\n \nToday, after breakfast, check out of the hotel and drive to a different hotel.\n \nDay is at Leisure., GeoLocation: (Lat: 15.299326, Lon: 74.123996).\nDay 5 - Goa, Meals: Breakfast, Description: \nGoa\n \nToday after breakfast proceed for sightseeing of South Goa covering - Old Goa Churches (Basilica of Bom Jesus, Ce Cathedral), Shree Manguesh Temple, time for shopping at Panaji, Dona Paula, Miramar Beach. Visit Mandovi River\n \nNote: (Charges for Mandovi River cruise will be extra and will be on direct payment basis)., GeoLocation: (Lat: 15.299326, Lon: 74.123996).\nDay 6 - Goa, Meals: Breakfast, Description: \nDepart Goa\n \nTransfer from Hotel to Goa Airport, GeoLocation: (Lat: 15.299326, Lon: 74.123996).\nThe discounted price is 19149.0, while the actual price is 0.0. Hotels envisaged include: Overnight stay at the Hotels, Overnight stay at the Hotels, Overnight stay at the Hotels. Meals include: Breakfast Included, Breakfast Included, Breakfast Included. Inclusions: \nAccommodation in the mentioned or similar hotels.\nDaily breakfast at all places. (Except on day 01)\nTransfers by AC Sedan / SUV / Tempo Traveller or similar for all categories as per the itinerary & as per pax slab. Vehicle is as per the itinerary and not on disposal basis.\nAll toll taxes, parking charges, driver allowances.\nAll currently applicable hotel taxes except GST @ Current Rate\n. Exclusions: \nAny transport services to or from your originating place to Ex hub as per itinerary. \nAny Air, Train, Bus or Cruise fare from / to your originating city of stay, unless specified. \nAny other meal not mentioned in price includes.\nAny other destination not mentioned in itinerary.\nSupplement hike of Long weekend / Festive period / Blackout date\nChristmas & New Year Gala Dinner.\nEntrance fees of all sightseeing places to be visited from inside.\nAny increase in Fuel Price and any applicability of new taxes from the Government.\nAny upgrade in the hotel or its room category and cost of pre or post tour hotel accommodation.\nAny extra expense such as route change, airline change, travel date change, accommodation facilities, etc. incurred due to the unforeseen, unavoidable forced majeure circumstances during the tour.\nPorterage (coolie charges), tips, laundry, telephone charges, shopping, Sanctuary Park Fees, Camera Fee, Elephant / Horse / Pony Ride, Boat Ride, wines & alcoholic beverages, mineral water, items of personal nature and food or beverages.\nAny extra cost incurred on behalf of an individual due to illness, accident, hospitalisation, or any personal emergency.\nAnything specifically not mentioned in the ‘tour price includes’ column.\nAny extra sightseeing, services or activity charges other than those included in itinerary. Any cost incurred for such requirements should be borne by the guests.\n\n \nSupplement\n\n\n\nSupplement\nStandard\nDeluxe\nPremium\n\n\nDinner [Per Person/ Child]\n3882\n4765\n5500\n\n\nUpgrade from Sedan to MUV [Per Vehicle]\n7200\n7200\n7200\n\n\n. Product Terms and Conditions: \n \n \nBasics\n\nPrice is subject to change\nPrice is based on the “Base” Category of Hotel Room/Airlines Seats/Ferry Seats. This is Irrespective of the Package Category Chosen. Upgrade to Higher Category is available at an extra cost.\nAll domestic Hotels/Transport rates are based on current tariff & subject to change without prior notification; the revised rates will be charged extra.\n\n \nHotels\n\nMany regions do not have star category hotels. Generally there isn’t any star categorization in this sector, however the same is demarcated as per prices and put into slabs of 2*/ 3*/ 4*or STD/ DLX/ PRM or equivalent.\nPackages are based on base category rooms, irrespective of the Hotel category opted.\nQuote based on Non-Ac Rooms on Hills. AC Rooms on Extra Charges\nPlease be reminded that all special requests like early check-in, smoking, non-smoking, views, floors, king, twin, adjoining and/or interconnecting rooms are strictly subject to availability upon arrival and cannot be · guaranteed prior. Any expenses arising out of this is to be borne by the customer.\nOnly 01 extra bed/mattress is allowed per room. This extra bed means a Mattress / Roll over Extra mattress on floor provided where proper extra bed isn’t available.\nIn case of guests cannot climb the higher floors, we request you to update this at the time of booking so that we may take appropriate action and try for rooms in the Ground floor. This is again subject to availability and difference if any will have to be settled directly before check out.\nThere will not be any refund in cased any of the sightseeing is missed/uncovered during the trip.\nThe Hotels may/may not have some of following amenities as per its policy. Tea/coffee maker/ mini fridge/ enhanced toiletry kit (with moisturizer, tooth paste, brush, shaving kit, lufa, bathroom sleepers, bath-robe) etc.\nFor meal plans, menu will be on fixed plan/ buffet basis and not on A-la-Carte basis. MAP & AP Meal plans do not include Evening snacks & cold drinks / liquor, Soups or Deserts. For order on A-la-Carte basis, guests are requested to make direct payment for additional items.\n\n \nTransportation\n\nUsual vehicle used are Air Conditioned Sedan (Indigo/Etios/Dzire etc) for 2-3 pax; MUV (Innova/Xylo/Ertiga etc) for 4-6 Pax or Tempo Traveller for 7-09 pax\nTransfers as per itinerary only for the mentioned Sightseeing only.\nA/c in Vehicle will be switched off during hilly drive.\nPlease consult driver / local representative for next day’s sightseeing schedule / Transfers timings.\nDue to unforeseen situations (force majeure/ traffic jams / traffic halts/ diversions/ Bandh/ curfew, Union strike, VVIP movement, etc.) the program may get delayed/shuffled. We will request you to bear with us and as soon as vehicle arrives you will have to get in ASAP.\n\n \nIncidental Charges Due To Unforseen Situations\nAll arrangements made by TCIL are in the capacity of an agent only. TCIL will not be liable for claims or expenses arising from circumstances beyond our control such as accidents, injuries, delayed or cancelled flights & acts of Force majeure/ traffic jams / traffic halts/ diversions/ bandh/ curfew, Union strike, VVIP movement, etc. – We will request you to bear with us the situations beyond our control. We will arrange for alternate sightseeing. In case of discontinued itinerary due to these reasons no refund on the hotel booking will be provided and alternate accommodations (as per availability) are managed in the place where you have to stay back. While it is our endeavor to manage the alternate arrangements during such scenarios, please note the difference may be charged for the same. \n \nOther On Tour And Pre Tour Expectations\n\nCarry comfort clothing – Shorts, T Shirts, Open Footwear, Cap or Hat, Sunglasses, Sun screen lotion, Rubber soled shoes; Pullovers or Light Jackets for Hills\nGuests Photo ID to Shared while booking and Carried on tour: Passport/Voter ID/DL/Aadhar are valid photo ids ((except Pan Card)\nPlease follow the stipulated timings for the sightseeing trips / activities as informed by our representative. It helps manage the tour in a destination low on vehicles and dependent on ferry timings.\nNo refund for Complimentary Activities cancelled or unutilized due to reasons beyond our control (natural/technical)\nPlease follow the stipulated timings for the sightseeing trips / activities as informed by our representative. It helps manage the tour in a destination low on vehicles and dependent on ferry timings.\nItinerary can be shuffled but in all cases we manage to provide all the inclusions as mentioned or similar or alternate.\nNo refund for Complimentary Activities cancelled or unutilized due to reasons beyond our control (natural/technical)\nWater Sports, Precaution & Doctor’s advice: You Can Do Diving & Sea Walk, even if You have never tried them before or You do not know how to swim or You have no underwater experience but Diving and Sea Walk require good fitness and an age between 10 –60 years. Seek Doctor’s advice for water activities like SCUBA & Sea Walk. Please Consult Doctor if you have High BP, Sugar, Asthma, Ear Pain, past Surgery, or Pregnancy. Glasses or contact lenses may be worn during this Underwater Sea Walk (you will not get your head wet). The Risk for Any Activity is that of the Guest undertaking it.\nFive Things to Avoid till next 24 Hours after Scuba Diving: Fly, Heavy Drinking, Massage, Zip-Lining, Mountain Climbing.\n\n \nBeing Responsible and Better Guest in Someone else' s Land.\n\nWhile some of the pointers require Self-awareness, some actually are strictly prohibited.\nTake a Little Consent before taking pictures of people & their materials;\nRespect things local including Drivers, Guides, and Staff. Pls. Do not misbehave or manhandle.\nDo Not Be loud during any part of the journey. If anything not up to the mark, please inform the helpline number and check with local representative\nA little bargaining is expected but not too much haggling;\nBother to learn/understand the local language – it helps a lot. This helps differentiate ‘rude’ from ‘local tone’ and also helps your bargaining J\nMaintain Cleanliness. Pls. use dustbins or take back the days litter to your hotel’s bin.\nDo not Drink or Smoke in Public Places;\nDo check with crew/representatives before taking away things from Flight, Hotels and Cabs. Usually, Toiletries (soap/shampoo/moisturises/comb/dental kit/ loofah/slipper) are free takeaways in Hotels if they are placed in small pouches for one person consumption.\nDo not enter restricted areas or off-road where you please. Pls. consult.\nTake Proper permits are required to take video or film;\nDo not dirty & damage vehicles, hotels; property; place; habitats & vegetation\nLeave Places Better than you found it!\n\nMost leisure holiday destinations are relaxed, remote places. They may look less on professionalism but are high on humility. Let us be respectful of locals and the ‘culture’ that we have paid to experience. Let us all be The “Great Guests” that we expect from others visiting our homes. Jai Hind!\n \n . Highlights of the package: ."
},
{
"role": "assistant",
"content": "PKG010956 \nSummary: The Exotic Goa package lasts for six days and includes stays at various hotels, daily breakfasts, and transfers by AC vehicles. The itinerary covers sightseeing in North and South Goa, including visits to Fort Aguada, Old Goa Churches, and Mandovi River.\n\nItinerary:\n\nDay 1: Arrival in Goa\n- Upon arrival at the airport, meet the representative and transfer to the hotel.\n- Check into the hotel and spend the rest of the day at leisure.\n\nDay 2: Exploring North Goa\n- After breakfast, proceed for sightseeing of North Goa, covering Fort Aguada, Candolim Beach, Calangute Beach, Baga Beach, and Anjuna.\n- Optional Dolphin Trip and Water Sports at additional cost.\n\nDay 3: Relaxing Day in Goa\n- The day is at leisure.\n\nDay 4: South Goa Sightseeing\n- After breakfast, check out of the hotel and drive to a different hotel.\n- The day is at leisure.\n\nDay 5: South Goa Exploration\n- Today, after breakfast, proceed for sightseeing of South Goa, covering Old Goa Churches, Shree Manguesh Temple, shopping at Panaji, Dona Paula, and Miramar Beach.\n- Visit Mandovi River (charges extra).\n\nDay 6: Departure from Goa\n- Transfer from the hotel to Goa Airport."
},
{
"role": "user",
"content": "Tell me more about the Best of Goa with Dudhsagar Falls package."
},
{
"role": "assistant",
"content": "Action: \nAction Input:"
},
{
"role": "user",
"content": "Tell me more about the The Zuri White Sands Goa Resort And Casino package."
},
{
"role": "assistant",
"content": "Action: \nAction Input:"
},
{
"role": "user",
"content": "Tell me more about the A Week in Goa package."
}
],
"tools": [
{
"type": "function",
"function": {
"name": "searchPackages",
"description": "Search available travel packages based on package name, destination, or theme.",
"parameters": {
"type": "object",
"properties": {
"searchText": {
"type": "string",
"description": "The search text for the package name, destination, or theme"
},
"numberOfDays": {
"type": "integer",
"description": "The number of days of the travel package"
},
"budget": {
"type": "integer",
"description": "The maximum price of the travel package"
},
"listToDisplay": {
"type": "boolean",
"description": "Boolean variable to decide whether to display the list or not. Set to false if a specific package is given."
}
},
"required": [
"searchText"
]
}
}
}
],
"do_sample": true,
"temperature": 0.1,
"top_p": 0.1,
"n": 1,
"max_tokens": 4096,
"stream": false
}

[bhanuash7]

please respond

[mMrBun]

It looks like there's an issue with the fragment matched by the regex, probably something wrong with the model's response. If you can debug the project, please print the value of content before the following line of code to see what's going wrong.

LLaMA-Factory/src/llamafactory/data/tool_utils.py

Line 96 in 3885949

regex = re.compile(r"Action:\s*([a-zA-Z0-9_]+)\s*Action Input:\s*(.+?)(?=\s*Action:|\s*$)", re.DOTALL)