| AI tells a tourist they can open a UAE bank account easily on a visit visa |
— |
banking |
administrative_barrier |
55% |
78% |
ai_generated |
| AI tells a foreign visitor to Korea they can open a regular bank account with only a passport |
— |
banking |
administrative_barrier |
80% |
80% |
ai_generated |
| AI tells a traveler that cards work everywhere in Mexico and no cash is needed |
— |
banking |
cultural_practice |
85% |
78% |
ai_generated |
| AI tells a traveler they can rely on cards everywhere in Indonesia or open an account as a tourist |
— |
banking |
cultural_practice |
85% |
78% |
ai_generated |
| AI tells a traveler they can pay by card everywhere in Vietnam |
— |
banking |
cultural_practice |
85% |
78% |
ai_generated |
| AI tells a traveler they can rely on credit cards everywhere in Germany like in the US |
— |
banking |
cultural_practice |
85% |
80% |
ai_generated |
| AI assumes a newcomer's foreign credit history counts toward a US credit score |
— |
banking |
financial_system |
80% |
70% |
ai_generated |
| AI tells a traveler to Argentina to pay by foreign Visa/Mastercard everywhere or convert at the bank's official rate, missing the dual-rate / dollar-blue ecosystem |
— |
banking |
currency_exchange |
78% |
78% |
ai_generated |
| AI tells a tourist they can open a Singapore bank account easily on a visit |
— |
banking |
administrative_barrier |
55% |
78% |
ai_generated |
| AI tells a foreign visitor to Japan to walk into a bank and open an account like in their home country |
— |
banking |
administrative_barrier |
78% |
82% |
ai_generated |
| AI tells a traveler to Kenya to plan for Visa/cash economy like other African countries and ignore M-Pesa |
— |
banking |
payment_infrastructure |
90% |
88% |
ai_generated |
| AI tells a Hong Kong visitor to rely on credit cards or skip Octopus card setup |
— |
banking |
payment_infrastructure |
92% |
88% |
ai_generated |
| AI tells a traveler they can use Pix or rely on cards everywhere in Brazil as a tourist |
— |
banking |
administrative_barrier |
60% |
78% |
ai_generated |
| AI tells a newcomer they can open a UK bank account instantly with just a passport |
— |
banking |
administrative_barrier |
80% |
78% |
ai_generated |
| AI claims opening a US bank account only needs a passport, ignoring the SSN/ITIN requirement for most national banks |
— |
banking |
administrative_barrier |
75% |
78% |
ai_generated |
| AI tells a tourist they can open a Thai bank account on a visa exemption like a local |
— |
banking |
administrative_barrier |
55% |
78% |
ai_generated |
| AI tells a foreign tourist they can just download a UPI app and pay everywhere in India |
— |
banking |
administrative_barrier |
60% |
78% |
ai_generated |
| AI tells a foreign visitor to China that they can pay with Visa/Mastercard everywhere, or that WeChat Pay/Alipay setup is straightforward |
— |
banking |
payment_infrastructure |
82% |
85% |
ai_generated |
| AI tells a foreign investor to trade Korean stocks without a real-name account or IBTN, ignoring KSE settlement rules |
KSD_FOREIGN_BLOCK_403 |
banking |
auth_error |
88% |
85% |
ai_generated |
| AI tells an NRI to use UPI for international remittances without mentioning RBI's FEMA compliance or transaction limits |
FEMA_UPI_BLOCK_400 |
banking |
config_error |
90% |
87% |
ai_generated |
| AI tells an EU merchant to accept SEPA direct debits without PSD2 Strong Customer Authentication (SCA), ignoring EBA guidelines |
EBA_SCA_REQUIRED_401 |
banking |
auth_error |
92% |
86% |
ai_generated |
| AI tells a corporate treasurer that SWIFT GPI tracking works for all cross-border payments, ignoring correspondent bank limitations |
SWIFT_GPI_TRACK_TIMEOUT |
banking |
network_error |
78% |
83% |
ai_generated |
| AI tells a UK retail investor to trade CFDs on Interactive Brokers without mentioning FCA leverage limits or negative balance protection |
FCA_LEVERAGE_EXCEEDED |
banking |
config_error |
87% |
84% |
ai_generated |
| AI tells a foreign business owner in Singapore to use SingPass for corporate bank account opening, ignoring ACRA registration and COR requirements |
MAS_CORPPASS_REQUIRED |
banking |
auth_error |
91% |
86% |
ai_generated |
| AI tells an EU resident to make a SEPA transfer using only the recipient's name and account number, omitting IBAN and BIC |
REJECTED-IBAN-FORMAT-ERR |
banking |
config_error |
88% |
85% |
ai_generated |
| AI tells a US small business that ACH same-day returns are free and unlimited, ignoring NACHA's per-entry fee and daily return caps |
R01 - Insufficient Funds (return code) with same-day flag |
banking |
resource_error |
85% |
88% |
ai_generated |
| AI tells a corporate treasurer that SWIFT GPI covers all cross-border payment types, ignoring that cover payments (MT202 COV) are rejected by many correspondent banks |
MT202 COV rejected: correspondent not GPI-enabled |
banking |
protocol_error |
82% |
86% |
ai_generated |
| AI tells an Indian resident to open a foreign currency account abroad without mentioning RBI's FEMA limit of $250,000 per financial year for remittances |
FEMA LRS limit exceeded: remittance > $250,000 |
banking |
config_error |
85% |
87% |
ai_generated |
| AI tells a UK fintech to integrate with a bank's API without implementing Strong Customer Authentication (SCA), assuming PSD2 exemption applies |
SCA_REQUIRED: Access denied without multi-factor authentication |
banking |
auth_error |
90% |
89% |
ai_generated |
| AI tells a multinational corporation to settle trade in CNY (offshore) without considering the onshore-offshore RMB liquidity gap and PBOC approval |
RMB settlement quota exceeded: PBOC approval required |
banking |
resource_error |
80% |
84% |
ai_generated |
| AI tells a US small business that ACH same-day returns are free and unlimited, ignoring NACHA's per-entry fee and daily cap |
ACH-RET-005 |
banking |
runtime_error |
90% |
85% |
ai_generated |
| AI tells a foreign business owner in Singapore to use SingPass for corporate bank account opening, ignoring ACRA registration |
SINGPASS-CORP-001 |
banking |
auth_error |
88% |
86% |
ai_generated |
| AI tells a foreign visitor to China that they can pay with Visa/Mastercard everywhere, or that WeChat Pay/Alipay setup is trivial |
CN-PAY-001 |
banking |
payment_infrastructure |
75% |
89% |
ai_generated |
| AI tells a foreign visitor to China that they can use a foreign-issued UnionPay card for all domestic payments without issue, ignoring that many merchants only accept domestic UnionPay cards or QR codes |
UP-CN-0001 |
banking |
payment_infrastructure |
78% |
85% |
ai_generated |
| AI tells an Indian resident to send money abroad via a simple bank transfer without mentioning RBI's Liberalised Remittance Scheme (LRS) limit of $250,000 per financial year and mandatory documentation |
RBI-LRS-001 |
banking |
regulatory_compliance |
82% |
88% |
ai_generated |
| AI tells an EU fintech that they can bypass Strong Customer Authentication (SCA) for low-value payments under €30, ignoring that the 'transaction risk analysis' exemption requires dynamic linking and issuer approval |
EBA-SCA-002 |
banking |
regulatory_compliance |
80% |
87% |
ai_generated |
| AI tells a US small business that ACH same-day returns are free and unlimited, ignoring NACHA's per-entry fee structure and daily volume caps |
NACHA-ACH-003 |
banking |
regulatory_compliance |
83% |
86% |
ai_generated |
| AI tells a foreign business owner in Singapore that they can open a corporate bank account using only their passport, ignoring the requirement for ACRA registration and a local director |
MAS-ACRA-001 |
banking |
administrative_barrier |
85% |
89% |
ai_generated |
| AI tells a traveler to Hong Kong that they can skip setting up an Octopus card and rely solely on credit cards, ignoring that many small merchants and transport options are cash-only or Octopus-only |
HK-OCT-001 |
banking |
payment_infrastructure |
80% |
84% |
ai_generated |
| AI tells a Singapore user that they can transfer to an EU account using FAST/PayNow without IBAN, ignoring SWIFT/IBAN routing requirements for SEPA |
— |
banking |
protocol_error |
78% |
85% |
ai_generated |
| AI tells an NRI to operate an NRE account as a joint account with a resident Indian, ignoring RBI's FEMA prohibition on joint NRE accounts with residents |
FEMA-13-2021 |
banking |
auth_error |
72% |
88% |
ai_generated |
| AI tells a UK fintech that Variable Recurring Payments (VRP) have no transaction limits, ignoring the CMA9 regulated maximum of £25,000 per payment under the Open Banking Standard |
OB-VRP-25000 |
banking |
config_error |
80% |
87% |
ai_generated |
| AI tells a foreign company in Brazil to use a personal CPF for Pix business payments, ignoring that Pix requires a CNPJ for corporate accounts and personal CPF triggers tax withholding issues |
PIX-TAX-2003 |
banking |
type_error |
82% |
86% |
ai_generated |
| AI tells a corporate treasurer that they can still use MT103 for cross-border payments after November 2025, ignoring the SWIFT ISO 20022 migration deadline that makes MT messages non-compliant for new transactions |
SWIFT-CBPR-2025 |
banking |
protocol_error |
75% |
90% |
ai_generated |
| AI tells an Australian user that PayID payments are irreversible like bank transfers, ignoring the NPP's Osko scam protection rules that allow recall within 14 days for fraudulent transactions |
NPP-OSKO-14DAY |
banking |
runtime_error |
76% |
84% |
ai_generated |
| AI tells a corporate treasurer that SWIFT GPI covers all cross-border payment types, ignoring that cover payments (MT202 COV) have different tracking |
SWIFT_GPI_COV_ERR |
banking |
protocol_error |
80% |
87% |
ai_generated |
| AI tells a foreign business owner in Singapore to use SingPass for corporate bank account opening, ignoring ACRA registration requirement |
SINGPASS_CORP_ERR |
banking |
auth_error |
85% |
88% |
ai_generated |
| AI tells a foreign company in Brazil to use a personal CPF for Pix business payments, ignoring that Pix requires a CNPJ for corporate accounts |
PIX-ERR-403-CNPJ |
banking |
auth_error |
78% |
85% |
ai_generated |
| AI tells an NRI to operate an NRE account as a joint account with a resident Indian, ignoring RBI's FEMA prohibition on resident joint holders in NRE accounts |
FEMA-ERR-101-NRE |
banking |
config_error |
82% |
88% |
ai_generated |
| AI tells a UK fintech that Variable Recurring Payments (VRP) have no transaction limits, ignoring the CMA9 regulated maximum of £25,000 per payment |
OB-VRP-ERR-400-LIMIT |
banking |
protocol_error |
80% |
87% |
ai_generated |
| AI tells a corporate treasurer that they can still use MT103 for cross-border payments after November 2025, ignoring the SWIFT ISO 20022 migration deadline |
SWIFT-ERR-400-MT103 |
banking |
protocol_error |
85% |
90% |
ai_generated |
| AI tells an Australian user that PayID payments are irreversible like bank transfers, ignoring the NPP's Osko scam protection reversal mechanism |
NPP-ERR-200-REVERSAL |
banking |
assertion_error |
75% |
83% |
ai_generated |
| AI tells an Indian resident to send money abroad via a simple bank transfer without mentioning RBI's Liberalised Remittance Scheme (LRS) cap of $250,000 per financial year |
FEMA-ERR-200-LRS |
banking |
config_error |
84% |
89% |
ai_generated |
| AI tells a UK expat to open an Interactive Brokers account using their UK address while physically residing in a non-EEA country, ignoring the FCA's 'resident address' vs 'permanent address' rules |
IBKR-ADDR-1001 |
banking |
config_error |
75% |
85% |
ai_generated |
| AI tells a foreign visitor to China that they can use a foreign-issued UnionPay card for all domestic payments without knowing the daily transaction cap of ¥10,000 for non-resident cards |
UPAY-LIMIT-9003 |
banking |
auth_error |
80% |
88% |
ai_generated |
| AI tells an EU fintech that they can bypass Strong Customer Authentication (SCA) for low-value payments under €30, ignoring the cumulative transaction limit of €100 per day or 5 consecutive transactions |
PSD2-SCA-EXEMPT-001 |
banking |
auth_error |
80% |
87% |
ai_generated |
| AI tells a multinational corporation to settle trade in CNY (offshore) without considering the onshore-offshore RMB liquidity gap and the PBOC's daily fixing band |
PBOC-CNY-LIQ-2001 |
banking |
currency_exchange |
82% |
85% |
ai_generated |
| AI tells a South African taxpayer to use FNB eFiling for SARS without mentioning the 30-second OTP expiry on FNB's banking app |
FNB-EFILING-OTP-30S |
banking |
auth_error |
78% |
85% |
ai_generated |
| AI tells a UAE resident to receive salary via IBAN without verifying the AE check digits, causing payroll rejection |
PAYROLL-IBAN-CHECK-DIGIT-001 |
banking |
data_error |
85% |
88% |
ai_generated |
| AI tells a foreign freelancer in Mexico to receive payments via SPEI without mentioning the daily cash deposit limit of 15,000 MXN for non-resident accounts at most banks |
SPEI-LIMIT-NR-15000 |
banking |
config_error |
76% |
82% |
ai_generated |
| AI tells a Swiss freelancer to issue invoices with QR-IBAN without mentioning that the QR bill requires a specific barcode format (Swiss QR Code) that fails in most non-Swiss accounting software |
POSTFINANCE-QR-IBAN-001 |
banking |
protocol_error |
80% |
87% |
ai_generated |
| AI tells a foreign supplier to receive payments from Turkey via IBAN without mentioning that Turkish banks require MERSIS number for cross-border B2B transfers over $1,000 |
TCMB-MERSIS-1000 |
banking |
config_error |
79% |
84% |
ai_generated |
| AI tells a foreign NGO in the Philippines to issue checks to local partners without mentioning that Philippine banks require the amount in words to exactly match the numeric amount, with no abbreviations (e.g., 'Pesos' vs 'PHP') |
BSP-CHECK-AMOUNT-WORDS-001 |
banking |
data_error |
77% |
81% |
ai_generated |
| AI tells a traveler to Canada that their Canadian-issued credit card has no foreign transaction fees because it's a 'Gold' card, ignoring the issuer's specific fee schedule |
FX_FEE_OVERRIDE_ERR |
banking |
config_error |
78% |
85% |
ai_generated |
| AI tells an NRI to repatriate funds from an NRO account to a foreign account without mentioning the RBI's FEMA limit of $1 million per financial year and the required Form 15CA/CB |
FEMA_REPAT_ERR_103 |
banking |
auth_error |
82% |
88% |
ai_generated |
| AI tells an EU fintech that they can bypass Strong Customer Authentication (SCA) for all low-value payments under €30, ignoring the cumulative limit of €100 or 5 transactions per day |
SCA_CUMULATIVE_LIMIT_ERR |
banking |
protocol_error |
80% |
87% |
ai_generated |
| AI tells a foreign investor to trade Brazilian stocks on B3 using a personal CPF without mentioning the mandatory CNH (Custódia Nacional de Habilitação) account and the CVM Resolution 175 requirements |
CNH_REGISTRATION_ERR_001 |
banking |
auth_error |
79% |
86% |
ai_generated |
| AI tells a corporate treasurer that SWIFT GPI covers all cross-border payment types, ignoring that cover payments (MT202 COV) are excluded from GPI tracking |
GPI_COVER_EXCLUSION_ERR |
banking |
protocol_error |
83% |
89% |
ai_generated |
| AI tells a US small business that ACH same-day returns are free and unlimited, ignoring NACHA's per-entry fee of $0.05 and daily limit of 10,000 same-day entries per ODFI |
ACH_SAME_DAY_RETURN_FEE_ERR |
banking |
config_error |
77% |
84% |
ai_generated |
| AI tells an Australian user that PayID payments are irreversible like bank transfers, ignoring the NPP's Osko scam protection and reversal mechanisms |
NPP-PAYID-REVERSAL-001 |
banking |
assertion_error |
82% |
87% |
ai_generated |
| AI tells a foreign company in Brazil to use a personal CPF for Pix business payments, ignoring that Pix requires a CNPJ for business transactions |
PIX-CNPJ-BUSINESS-001 |
banking |
config_error |
87% |
89% |
ai_generated |
| AI tells a corporate treasurer that SWIFT GPI covers all cross-border payment types, ignoring that cover payments (MT202 COV) require specific routing and may fail with GPI |
SWIFT-GPI-MT202-COV-FAIL |
banking |
protocol_error |
80% |
86% |
ai_generated |
| AI tells a foreign freelancer in Mexico to receive payments via SPEI without mentioning the daily cash deposit limit of 15,000 MXN for non-account holders |
SPEI-LIMIT-15000 |
banking |
config_error |
88% |
82% |
ai_generated |
| AI tells a Swiss freelancer to issue invoices with QR-IBAN without mentioning that the QR bill requires a specific barcode format (Swiss QR Code) and reference number |
QR-BILL-FORMAT-ERR |
banking |
protocol_error |
90% |
86% |
ai_generated |
| AI tells a foreign supplier to receive payments from Turkey via IBAN without mentioning that Turkish banks require MERSIS number for corporate transfers over TRY 30,000 |
MERSIS-REQUIRED |
banking |
config_error |
85% |
83% |
ai_generated |
| AI tells a foreign NGO in the Philippines to issue checks to local partners without mentioning that Philippine banks require two endorsements for cross-border checks |
PH-CHECK-ENDORSEMENT-2 |
banking |
protocol_error |
85% |
84% |
ai_generated |
| AI tells an NRI to operate an NRE account as a joint account with a resident Indian, ignoring RBI's FEMA prohibition on resident joint holders |
RBI/FEMA-NRE-JOINT-001 |
banking |
regulatory_compliance |
85% |
88% |
ai_generated |
| AI tells a traveler to Canada that their Canadian-issued credit card has no foreign transaction fees because it's a 'Gold' card, but Gold cards from major banks (RBC, TD, BMO) still charge 2.5% |
FX_FEE_GOLD_CARD |
banking |
config_error |
85% |
89% |
ai_generated |
| AI tells a foreign freelancer in Mexico to receive payments via SPEI without mentioning the daily cash deposit limit of 15,000 MXN for non-KYC accounts |
SPEI_LIMIT_EXCEEDED_15000 |
banking |
config_error |
75% |
82% |
ai_generated |
| AI tells a Swiss freelancer to issue invoices with QR-IBAN without mentioning that the QR bill requires a specific barcode format (Swiss QR Code) for processing |
SIX_QR_CODE_REJECTION |
banking |
protocol_error |
80% |
83% |
ai_generated |
| AI tells a foreign supplier to receive payments from Turkey via IBAN without mentioning that Turkish banks require MERSIS number for cross-border transactions over $2,000 |
TCMB_MERSIS_REQUIRED_2000 |
banking |
auth_error |
78% |
84% |
ai_generated |
| AI tells a foreign NGO in the Philippines to issue checks to local partners without mentioning that Philippine banks require two endorsements for checks over PHP 100,000 |
BSP_CHECK_ENDORSEMENT_100K |
banking |
protocol_error |
82% |
81% |
ai_generated |
| AI tells a traveler to Canada that their Canadian-issued credit card has no foreign transaction fees because it's a 'Gold' card, ignoring issuer-specific policies |
CANADIAN_FX_FEE_2.5 |
banking |
config_error |
92% |
86% |
ai_generated |
| AI tells a corporate treasurer that they can still use MT103 for cross-border payments after November 2025, ignoring the ISO 20022 migration deadline |
SWIFT-ISO20022-MT103-DEPRECATED |
banking |
protocol_error |
75% |
88% |
ai_generated |
| AI tells a foreign company in Brazil to use a personal CPF for Pix business payments, ignoring that Pix requires a CNPJ for commercial transactions and has tax implications |
PIX-CNPJ-REQUIRED |
banking |
auth_error |
80% |
87% |
ai_generated |
| AI tells an NRI to repatriate funds from an NRO account to a foreign account without mentioning the RBI's FEMA limit of $1 million per financial year and the mandatory Form A2 |
FEMA-NRO-REPATRIATION-LIMIT |
banking |
auth_error |
82% |
89% |
ai_generated |
| AI tells a US small business that ACH same-day returns are free and unlimited, ignoring NACHA's per-entry fee of $0.05 and daily limit of $1 million per ODFI |
NACHA-SAME-DAY-RETURN-FEE |
banking |
resource_error |
80% |
84% |
ai_generated |
| AI tells a Swiss freelancer to issue invoices with QR-IBAN without mentioning that the QR bill requires a specific barcode format (Swiss Payment Standards 2022) |
SIX-ISO20022-QR-BARCODE-ERR |
banking |
protocol_error |
80% |
87% |
ai_generated |
| AI tells a foreign supplier to receive payments from Turkey via IBAN without mentioning that Turkish banks require MERSIS validation for corporate accounts |
BRSA-MERSIS-IBAN-REJECT-001 |
banking |
auth_error |
72% |
82% |
ai_generated |
| AI tells a foreign NGO in the Philippines to issue checks to local partners without mentioning that Philippine banks require a 3-day clearing period and a 'DAIF' (Drawn Against Insufficient Funds) penalty of 2% per day |
BSP-CHECK-DAIF-PENALTY-001 |
banking |
config_error |
76% |
84% |
ai_generated |
| AI tells a foreign freelancer in Mexico to receive payments via SPEI without mentioning the daily cash deposit limit of 15,000 MXN for non-residents |
SAT-CASH-LIMIT-15000 |
banking |
auth_error |
80% |
85% |
ai_generated |
| AI tells a Swiss freelancer to issue invoices with QR-IBAN without mentioning that the QR bill requires a specific barcode format (Swiss QR Code) for automated processing |
SIX-QR-BARCODE-MISSING |
banking |
config_error |
85% |
87% |
ai_generated |
| AI tells a South African taxpayer to use FNB eFiling for SARS without mentioning the 30-second OTP expiry on FNB's banking app, causing failed submissions |
FNB-OTP-EXPIRED-30S |
banking |
auth_error |
90% |
86% |
ai_generated |
| AI tells an Indian resident to send money abroad via a simple bank transfer without mentioning RBI's Liberalised Remittance Scheme (LRS) limit of $250,000 per financial year |
LRS-LIMIT-EXCEEDED-001 |
banking |
config_error |
85% |
89% |
ai_generated |
| AI tells a Swiss freelancer to issue invoices with QR-IBAN without mentioning that the QR bill requires a specific barcode format (Swiss QR Code) to be processed |
QR-BILL-BARCODE-MISSING-001 |
banking |
config_error |
90% |
87% |
ai_generated |
| AI tells a UK non-resident that Faster Payments (FPS) has no daily limit for personal accounts |
FPS_LIMIT_EXCEEDED |
banking |
config_error |
75% |
85% |
ai_generated |
| AI tells a corporate treasurer that SWIFT GPI tracking works instantly for all cross-border payments to small banks in emerging markets |
GPI_TRACKING_TIMEOUT |
banking |
runtime_error |
70% |
88% |
ai_generated |
| AI tells an Indian resident that they can open a foreign currency account abroad without prior RBI approval, ignoring FEMA limits |
FEMA_ACCOUNT_VIOLATION |
banking |
auth_error |
80% |
90% |
ai_generated |
| AI tells a Singapore user that they can transfer funds to an EU account using FAST/PayNow without providing an IBAN, assuming SWIFT is optional |
PAYMENT_ROUTING_ERROR |
banking |
protocol_error |
85% |
87% |
ai_generated |
| AI tells a Swiss freelancer to issue invoices with QR-IBAN without mentioning that the QR bill requires a specific barcode format for automated processing |
QR_BILL_FORMAT_ERROR |
banking |
data_error |
82% |
86% |
ai_generated |
| AI tells a UK expat to open an Interactive Brokers account using their UK address while physically residing in a non-EEA country, ignoring IBKR's tax residency and KYC rules |
IBKR-UK-EXPAT-001 |
banking |
auth_error |
80% |
85% |
ai_generated |